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Appendix A. Laplace 

Pierre Simon de Laplace (1749-1827) was a French mathematician and theo¬ 
retical astronomer who was so famous in his own time that he was known 
as the Newton of France. His main interests throughout his life were celestial 
mechanics, the theory of probability, and personal advancement. 

At the age of twenty-four he was already deeply engaged in the detailed 
application of Newton's law of gravitation to the solar system as a whole, in 
which the planets and their satellites are not governed by the sun alone but 
interact with one another in a bewildering variety of ways. Even Newton 
had been of the opinion that divine intervention would occasionally be 
needed to prevent this complex mechanism from degenerating into chaos. 
Laplace decided to seek reassurance elsewhere, and succeeded in proving 
that the ideal solar system of mathematics is a stable dynamical system 
that will endure unchanged for all time. This achievement was only one of 
the long series of triumphs recorded in his monumental treatise Mecanique 
Celeste (published in five volumes from 1799 to 1825), which summed up the 
work on gravitation of several generations of illustrious mathematicians. 
Unfortunately for his later reputation, he omitted all reference to the dis¬ 
coveries of his predecessors and contemporaries, and left it to be inferred 
that the ideas were entirely his own. Many anecdotes are associated with 
this work. One of the best known describes the occasion on which Napoleon 
tried to get a rise out of Laplace by protesting that he had written a huge 
book on the system of the world without once mentioning God as the author 
of the universe. Laplace is supposed to have replied, "Sire, I had no need of 
that hypothesis." The principal legacy of the Mecanique Celeste to later gen¬ 
erations lay in Laplace's wholesale development of potential theory, with its 
far-reaching implications for a dozen different branches of physical science 
ranging from gravitation and fluid mechanics to electro-magnetism and 
atomic physics. Even though he lifted the idea of the potential from Lagrange 
without acknowledgment, he exploited it so extensively that ever since his 
time the fundamental differential equation of potential theory has been 
known as Laplace's equation. 

His other masterpiece was the treatise Theorie Analytique des Probabilities 
(1812), in which he incorporated his own discoveries in probability from 
the preceding 40 years. Again he failed to acknowledge the many ideas 
of others he mixed in with his own; but even discounting this, his book is 
generally agreed to be the greatest contribution to this part of mathematics 
by any one man. In the introduction he says: "At bottom, the theory of 
probability is only common sense reduced to calculation." This may be 
so, but the following 700 pages of intricate analysis—in which he freely 
used Laplace transforms, generating functions, and many other highly 
nontrivial tools—has been said by some to surpass in complexity even the 
Mecanique Celeste. 
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After the French Revolution Laplace's political talents and greed for posi¬ 
tion came to full flower. His countrymen speak ironically of his "supple¬ 
ness" and "versatility" as a politician. What this really means is that each 
time there was a change of regime (and there were many), Laplace smoothly 
adapted himself by changing his principles—back and forth between fer¬ 
vent republicanism and fawning royalism—and each time he emerged with 
a better job and grander titles. He has been aptly compared with the apocry¬ 
phal Vicar of Bray in English literature, who was twice a Catholic and twice a 
Protestant. The Vicar is said to have replied as follows to the charge of being 
a turncoat: "Not so, neither, for if I changed my religion, I am sure I kept true 
to my principle, which is to live and die the Vicar of Bray." 

To balance his faults, Laplace was always generous in giving assistance 
and encouragement to younger scientists. From time to time he helped for¬ 
ward in their careers such men as the chemist Gay-Lussac, the traveler and 
naturalist Humboldt, the physicist Poisson, and—appropriately—the young 
Cauchy, who was destined to become one of the chief architects of nineteenth 
century mathematics. 


Appendix B. Abel 

Niels Henrik Abel (1802-1829) was one of the foremost mathematicians of 
the nineteenth century and probably the greatest genius produced by the 
Scandinavian countries. Along with his contemporaries Gauss and Cauchy, 
Abel was one of the pioneers in the development of modern mathematics, 
which is characterized by its insistence on rigorous proof. His career was a 
poignant blend of good-humored optimism under the strains of poverty and 
neglect, modest satisfaction in the many towering achievements of his brief 
maturity, and patient resignation in the face of an early death. 

Abel was one of six children in the family of a poor Norwegian country 
minister. His great abilities were recognized and encouraged by one of his 
teachers when he was only sixteen, and soon he was reading and digesting 
the works of Newton, Euler, and Lagrange. As a comment on this experience, 
he inserted the following marginal remark in one of his later mathematical 
notebooks: "It appears to me that if one wants to make progress in math¬ 
ematics, one should study the masters and not the pupils." When Abel was 
only eighteen his father died and left the family destitute. They subsisted by 
the aid of friends and neighbors, and somehow the boy, helped by contribu¬ 
tions from several professors, managed to enter the University of Oslo in 
1821. His earliest researches were published in 1823, and included his solu¬ 
tion of the classic tautochrone problem by means of the integral equation 
discussed in Section 52. This was the first solution of an equation of this 
kind, and foreshadowed the extensive development of integral equations in 
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the late nineteenth and early twentieth centuries. He also proved that the 
general fifth degree equation ax 5 + bx i + cx 3 + dx 2 + ex +/= 0 cannot be solved 
in terms of radicals, as is possible for equations of lower degree, and thus 
disposed of a problem that had baffled mathematicians for 300 years. He 
published his proof in a small pamphlet at his own expense. 

In his scientific development Abel soon outgrew Norway, and longed to 
visit France and Germany. With the backing of his friends and professors 
he applied to the government, and after the usual red tape and delays, he 
received a fellowship for a mathematical grand tour of the Continent. He 
spent most of his first year abroad in Berlin. Here he had the great good 
fortune to make the acquaintance of August Leopold Crelle, an enthusias¬ 
tic mathematical amateur who became his close friend, advisor, and protec¬ 
tor. In turn, Abel inspired Crelle to launch his famous journal fur die Reine 
und Angezvandte Mathematik, which was the world's first periodical devoted 
wholly to mathematical research. The first three volumes contained 22 con¬ 
tributions by Abel. 

Abel's early mathematical training had been exclusively in the older for¬ 
mal tradition of the eighteenth century, as typified by Euler. In Berlin he 
came under the influence of the new school of thought led by Gauss and 
Cauchy, which emphasized rigorous deduction as opposed to formal cal¬ 
culation. Except for Gauss's great work on the hypergeometric series, there 
were hardly any proofs in analysis that would be accepted as valid today. As 
Abel expressed it in a letter to a friend: "If you disregard the very simplest 
cases, there is in all of mathematics not a single infinite series whose sum 
has been rigorously determined. In other words, the most important parts of 
mathematics stand without a foundation." In this period he wrote his clas¬ 
sic study of the binomial series, in which he founded the general theory of 
convergence and gave the first satisfactory proof of the validity of this series 
expansion. 

Abel had sent to Gauss in Gottingen his pamphlet on the fifth degree equa¬ 
tion, hoping that it would serve as a kind of scientific passport. However, for 
some reason Gauss put it aside without looking at it, for it was found uncut 
among his papers after his death 30 years later. Unfortunately for both men, 
Abel felt that he had been snubbed, and decided to go on to Paris without 
visiting Gauss. 

In Paris he met Cauchy, Legendre, Dirichlet, and others, but these meet¬ 
ings were perfunctory and he was not recognized for what he was. He had 
already published a number of important articles in Crelle's Journal, but the 
French were hardly aware yet of the existence of this new periodical and 
Abel was much too shy to speak of his own work to people he scarcely knew. 
Soon after his arrival he finished his great Memoire sur line Propriety Generale 
d'une Classe Tres Etendue des Fonctions Transcendantes, which he regarded as 
his masterpiece. This work contains the discovery about integrals of alge¬ 
braic functions now known as Abel's theorem, and is the foundation for the 
later theory of Abelian integrals. Abelian functions, and much of algebraic 
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geometry. Decades later, Hermite is said to have remarked of this Memoire: 
"Abel has left mathematicians enough to keep them busy for 500 years." Jacobi 
described Abel's theorem as the greatest discovery in integral calculus of the 
nineteenth century. Abel submitted his manuscript to the French Academy. 
He hoped that it would bring him to the notice of the French mathemati¬ 
cians, but he waited in vain until his purse was empty and he was forced 
to return to Berlin. What happened was this: the manuscript was given to 
Cauchy and Legendre for examination; Cauchy took it home, mislaid it, and 
forgot all about it; and it was not published until 1841, when again the manu¬ 
script was lost before the proof sheets were read. The original finally turned 
up in Florence in 1952. 5 In Berlin, Abel finished his first revolutionary article 
on elliptic functions, a subject he had been working on for several years, and 
then went back to Norway, deeply in debt. 

He had expected on his return to be appointed to a professorship at the 
university, but once again his hopes were dashed. He lived by tutoring, and 
for a brief time held a substitute teaching positon. During this period he 
worked incessantly, mainly on the theory of the elliptic functions that he 
had discovered as the inverses of elliptic integrals. This theory quickly took 
its place as one of the major fields of nineteenth century analysis, with many 
applications to number theory, mathematical physics, and algebraic geom¬ 
etry. Meanwhile, Abel's fame had spread to all the mathematical centers of 
Europe and he stood among the elite of the world's mathematicians, but in 
his isolation he was unaware of it. By early 1829 the tuberculosis he con¬ 
tracted on his journey had progressed to the point where he was unable to 
work, and in the spring of that year he died, at the age of twenty-six. As an 
ironic postcript, shortly after his death Crelle wrote that his efforts had been 
successful, and that Abel would be appointed to the chair of mathematics in 
Berlin. 

Crelle eulogized Abel in his Journal as follows: "All of Abel's works carry 
the imprint of an ingenuity and force of thought which is amazing. One may 
say that he was able to penetrate all obstacles down to the very foundation 
of the problem, with a force which appeared irresistible... He distinguished 
himself equally by the purity and nobility of his character and by a rare 
modesty which made his person cherished to the same unusual degree as 
was his genius." Mathematicians, however, have their own ways of remem¬ 
bering their great men, and so we speak of Abel's integral equation. Abelian 
integrals and functions. Abelian groups, Abel's series, Abel's partial summa¬ 
tion formula, Abel's limit theorem in the theory of power series, and Abel 
summability. Few have had their names linked to so many concepts and 
theorems in modern mathematics, and what he might have accomplished in 
a normal lifetime is beyond conjecture. 


5 For the details of this astonishing story, see the fine book by O. Ore, Niels Henrik Abel: 
Mathematician Extraordinary, University of Minnesota Press, Minneapolis, 1957. 
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54 General Remarks on Systems 

One of the fundamental concepts of analysis is that of a system of n simul¬ 
taneous first order differential equations. If i/,(x), y 2 (x),..., y n (x) are unknown 
functions of a single independent variable x, then the most general system 
of interest to us is one in which their derivatives y\,y'i, ... ,y’„ are explicitly 
given as functions of x and y v y 2/ ..., y„: 

y'i = f\{x,y l ,y 2 , ... ,y„) 
y'i = Hx,y x ,y 2 , ... , y„) 

( 1 ) 


y'n = fn{x,yx,y 2 , ■■■ ,y„). 


Systems of differential equations arise quite naturally in many scientific 
problems. In Section 22 we used a system of two second order linear equa¬ 
tions to describe the motion of coupled harmonic oscillators; in the example 
below we shall see how they occur in connection with dynamical systems 
having several degrees of freedom; and in Section 57 we will use them to 
analyze a simple biological community composed of different species of ani¬ 
mals interacting with one another. 

An important mathematical reason for studying systems is that the single 
nth order equation 


yM=/(*,y,yyM) 

can always be regarded as a special case of (1). To see this, we put 

yi = y, y 2 =y'/ y n =y (n ~ 1) 


( 2 ) 

( 3 ) 
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and observe that (2) is equivalent to the system 

yi = y 2 

y2 = y 3 

y'n = f(x,y lr y 2 , ... ,y„\ 


which is clearly a special case of (1). The statement that (2) and (4) are equiva¬ 
lent is understood to mean the following: if y(x) is a solution of equation (2), 
then the functions y x (x), y 2 {x),. .., y„(x) defined by (3) satisfy (4); and conversely, 
if yfx), y 2 (x),. ■., y„(x) satisfy (4), then y(x) = yfx) is a solution of (2). 

This reduction of an nth order equation to a system of n first order equa¬ 
tions has several advantages. We illustrate by considering the relation 
between the basic existence and uniqueness theorems for the system (1) and 
for equation (2). 

If a fixed point x = x 0 is chosen and the values of the unknown functions 

yi(x 0 )=a 1 , y 2 (x 0 )= a 2 , ..., y„(x 0 ) = a n (5) 

are assigned arbitrarily in such a way that the functions/,,/^.. .,/„ are defined, 
then (1) gives the values of the derivatives y;(x 0 ),y 2 (x 0 ), , y»(*o) The simi¬ 

larity between this situation and that discussed in Section 2 suggests the 
following analog of Picard's theorem. 


Theorem A. Let the functions f,f 2/ . . .,/„ and the partial derivatives df/dy y ... ,df/ 
dy n , ... ,df n /dy lr ... ,df„/dy n be continuous in a region R of(x, y v y 2 ,..., y n ) space. If 
(x 0 , a v a 2 ,..., a n ) is an interior point ofR, then the system (1) has a unique solutioii 
yfx), y 2 (x),..., y„(x) that satisfies the initial coiiditions (5). 

We will not prove this theorem, but instead remark that when the ground 
has been properly prepared, its proof is identical with that of Picard's theo¬ 
rem as given in Chapter 13. Furthermore, by virtue of the above reduction. 
Theorem A includes as a special case the following corresponding theorem 
for equation (2). 


Theorem B. Let the function f and the partial derivatives df/dy, df/dy',..., 3//3y (,,_1) 
be continuous in a region R of(x, y, y',..., y (,!_1) ) space. If (x 0 , a v a 2/ ..., «„) is an interior 
point ofR, then equation (2) has a unique solution y(x) that satisfies the initial condi¬ 
tions y(x 0 ) - y'(x 0 ) = a 2r .., y {n ~ l \x 0 ) = a n . 

As a further illustration of the value of reducing higher order equations to 
systems of first order equations, we consider the famous n-body problem of 
classical mechanics. 
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FIGURE 69 


Let n particles with masses m l be located at points (x„ i/„ z,) and assume 
that they attract one another according to Newton's law of gravitation. If is 
the distance between m, and nq, and if 0 is the angle from the positive x-axis 
to the segment joining them (Figure 69), then the x component of the force 
exerted on m, by m is 


Gm I m l 


cos 0 = 


Gm,mj(Xj -x,) 


r ? 

r ‘i 


where G is the gravitational constant. Since the sum of these components 
for all j / i equals mfFxfdt 2 ), we have n second order differential equations 


d 2 x, 


-<=r 


mfXj-Xj) 




and similarly 


d 2 yi [ ; y /»•('/ '/.) 

dt 2 ^ r» 




and 


d 2 Zi 

dt 2 
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If we put v Xi = dxj/dt , v yi = dyt/dt , and v Zl = dzi/dt, and apply the above reduc¬ 
tion, then we obtain a system of 6 n equations of the form (1) in the unknown 
functions x 1 , v xi ,..., x n , v Xn , y lt v yi , ... , y n , v y „, z lr v zi ,..., z n , v Zn . If we now make 
use of the fact that 


r$ = [(*/ - xf 1 2 + (y, - yff + (z, - z,-) 2 ] 3/2 , 

then Theorem A yields the following conclusion: if the initial positions and 
initial velocities of the particles, i.e., the values of the unknown functions at a 
certain instant t = t 0 , are given, and if the particles do not collide in the sense 
that the r y do not vanish, then their subsequent positions and velocities are 
uniquely determined. This conclusion underlies the once popular philoso¬ 
phy of mechanistic determinism, according to which the universe is nothing 
more than a gigantic machine whose future is inexorably fixed by its state at 
any given moment. 1 


Problems 

1. Replace each of the following differential equations by an equivalent 
system of first order equations: 

(a) y" -x 2 y' -xy = 0; 

(b) y^if-xfyf. 

2. If a particle of mass m moves in the xy-plane, its equations of motion are 

m^y = /(h^y) and m^ = g(t,x,y), 

where / and g represent the x and y components, respectively, of the 
force acting on the particle. Replace this system of two second order 
equations by an equivalent system of four first order equations of the 
form (1). 


1 It also led Sir James Jeans to define the universe as "a self-solving system of 6N simultaneous 
differential equations, where N is Eddington's number." Sir Arthur Eddington asserted (with 
more poetry than truth) that 


N = — x 136 x 2 256 

2 

is the total number of particles of matter in the universe. See Jeans, The Astronomical Horizon, 
Oxford University Press, London, 1945; or Eddington, The Expanding Universe, Cambridge 
University Press, London, 1952. 
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55 Linear Systems 

For the sake of convenience and clarity, we restrict our attention through 
the rest of this chapter to systems of only two first order equations in two 
unknown functions, of the form 


§» Ht.x.y) 

~rr = G(t,x,y). 
I at 


(i) 


The brace notation is used to emphasize the fact that the equations are linked 
together, and the choice of the letter t for the independent variable and x and 
y for the dependent variables is customary in this case for reasons that will 
appear later. 

In this and the next section we specialize even further, to linear systems, of 
the form 


— = ai(t)x + b 1 (t)y + /i(f) 
at 

wf = a 2 (0 X + b 2 (t)y + f 2 (t). 
dt 


( 2 ) 


We shall assume in the present discussion, and in the theorems stated below, 
that the functions a^t), b,(t), and f(t), i = 1 , 2 , are continuous on a certain closed 
interval [a, b] of the f-axis. If/i(f) and/ 2 (f) are identically zero, then the system 
(2) is called homogeneous-, otherwise it is said to be nonhomogeneous. A solu¬ 
tion of (2) on [a, b] is of course a pair of functions x(t) and y(t) that satisfy both 
equations of (2) throughout this interval. We shall write such a solution in 
the form 


x = x(t) 

y = y(0- 


Thus, it is easy to verify that the homogeneous linear system (with constant 
coefficients) 



( 3 ) 
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has both 


x = e l 


y = e 


,3f 


,3f 


and 



( 4 ) 


as solutions on any closed interval. 

We now give a brief sketch of the general theory of the linear system (2). It 
will be observed that this theory is very similar to that of the second order 
linear equation as described in Sections 14 and 15. We begin by stating the 
following fundamental existence and uniqueness theorem, whose proof is 
given in Chapter 13. 

Theorem A. If t 0 is any point of the interval [a, b], and ifx 0 and y 0 are any numbers 
whatever, then (2) has one and only one solution 


x = x(t) 

y=y(t), 


valid throughout [a, b], such that x(t 0 )-x 0 and y(t Q )=y 0 . 

Our next step is to study the structure of the solutions of the homogeneous 
system obtained from (2) by removing the terms/! (f) and/ 2 (f): 


— = a 1 (t)x + b 1 (t)y 


dt 


( 5 ) 



. dt 


It is obvious that (5) is satisfied by the so-called trivial solution, in which x(t) 
and y(t) are both identically zero. Our main tool in constructing more useful 
solutions is the next theorem. 

Theorem B. If the homogeneous system (5) has two solutions 



and 



( 6 ) 


on [a, b], then 


x = cpe/f) + c 2 x 2 (t) 
y = c 1 y 1 (t)+c 2 y 2 (t) 


( 7 ) 


is also a solution on [a, b]for any constants c v and c 2 . 
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Proof. The proof is a routine verification, and is left to the reader. 

The solution (7) is obtained from the pair of solutions (6) by multiplying 
the first by c v the second by c 2 , and adding; (7) is therefore called a linear com¬ 
bination of the solutions (6). With this terminology, we can restate Theorem 
B as follows: any linear combination of two solutions of the homogeneous 
system (5) is also a solution. Accordingly, (3) has 

[ x = Cie 3f + c 2 e 2 ' 

[y = Cie 3f + 2 c 2 e 2 ' ® 

as a solution for every choice of the constants c x and c 2 . 

The next question we must settle is that of whether (7) contains all solu¬ 
tions of (5) on [a, b], that is, whether it is the general solution of (5) on [a, b]. 
By Theorem A, (7) will be the general solution if the constants c x and c 2 can 
be chosen so as to satisfy arbitrary conditions x(t i} ) = x 0 and y(t 0 )-y 0 at an 
arbitrary point t 0 in [a, b], or equivalently, if the system of linear algebraic 
equations 


CiXfQ + c 2 x 2 (f 0 ) — x 0 
c i 3 /i(^o) + c 2 }/ 2 (^ 0 ) = Vo 

in the unknowns c 1 and c 2 can be solved for each t 0 in [a, b] and every pair of 
numbers x 0 and y 0 . By the elementary theory of determinants, this is possible 
whenever the determinant of the coefficients. 


W(f) = 


Xi(t) 

yi(f) 


*2 (f) 

1/2(0 


does not vanish on the interval [a, b\. This determinant is called the Wronskian 
of the two solutions (6) (see Problem 4), and the above remarks prove the next 
theorem. 


Theorem C. If the tzvo solutions (6) of the homogeneous system (5) have a Wronskian 
W(t) that does not vanish on [a, b], then (7) is the general solution of (5) on this 
interval. 


It follows from this theorem that (8) is the general solution of (3) on any closed 
interval, for the Wronskian of the two solutions (4) is 


W(f) = 


e 2f 

2e 2f 


= e 5f . 
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which never vanishes. It is useful to know, as this example suggests, that the 
vanishing or nonvanishing of the Wronskian W(t) of two solutions does not 
depend on the choice of t. To state it formally, we have 

Theorem D. lfW(t) is the Wronskian of the two solutions (6) of the homogeneous 
system (5), then W(t) is either identically zero or nowhere zero on [a, b]. 

Proof. A simple calculation shows that W(t) satisfies the first order differen¬ 
tial equation 

dW 

^T = [ aft) + b 2 {t)]W, (9) 

dr 


from which it follows that 


W(t) = cJ Mt)+bm]dt (10) 

for some constant c. The conclusion of the theorem is now evident from the 
fact that the exponential factor in (10) never vanishes on [a, b]. 

Theorem C provides an adequate means of verifying that (7) is the general 
solution of (5): show that the Wronskian W(t) of the two solutions (6) does 
not vanish. We now develop an equivalent test that is often more direct and 
convenient. 

The two solutions (6) are called linearly dependent on [a, b] if one is a con¬ 
stant multiple of the other in the sense that 

Xi(t) = kx 2 (t) x 2 (t) = kxft) 

or 

yft) = ky 2 (t) y 2 (t) = kyft) 

for some constant k and all t in [a, b\, and linearly independent if neither is a 
constant multiple of the other. It is clear that linear dependence is equivalent 
to the condition that there exist two constants c l and c 2 , at least one of which 
is not zero, such that 


Cixdf) + c 2 x 2 (t) = 0 

( 11 ) 

ciyft) + c 2 y 2 (f) = 0 
for all t in [a, b\. We now have the next theorem. 

Theorem E. If the two solutions (6) of the homogeneous system (5) are linearly inde¬ 
pendent on [a, b], then (7) is the general solution of (5) on this interval. 

Proof. In view of Theorems C and D, it suffices to show that the solutions (6) 
are linearly dependent if and only if their Wronskian W(f) is identically zero. 
We begin by assuming that they are linearly dependent, so that, say. 
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Then 


x 1 (t) =kx 2 (t) 
yft) = ky 2 (t). 

kx 2 (t) x 2 (t) 
tyi(t) 1 / 2(0 
= kx 2 {t)y 2 (t) - kx 2 (t)y 2 (t) = 0 


W(t) = 


Xi(t) x 2 (t) 
yi (0 1/2(0 


( 12 ) 


for all t in [a, b\. The same argument works equally well if the constant k is on 
the other side of equations (12). We now assume that W(t) is identically zero, 
and show that the solutions (6) are linearly dependent in the sense of equa¬ 
tions (11). Let t 0 be a fixed point in [a, b\. Since W(f 0 ) = 0, the system of linear 
algebraic equations 

Cl*l(0) + C 2 X 2^o) ~ 0 
ciyi(0)+ c 2}/2(^0 ) = 0 

has a solution c, c 2 in which these numbers are not both zero. Thus, the solu¬ 
tion of (5) given by 

(x = c 1 x 1 (t) + c 2 x 2 (t) ^ 

1j/ = c 1 i/i(0 + c 2 i/ 2 (0 

equals the trivial solution at t 0 . It now follows from the uniqueness part of 
Theorem A that (13) must equal the trivial solution throughout the interval 
[a, b], so (11) holds and the proof is complete. 


The value of this test is that in specific problems it is usually a simple matter 
of inspection to decide whether two solutions of (5) are linearly independent 
or not. 

We now return to the nonhomogeneous system (2) and conclude our dis¬ 
cussion with 


Theorem F .If the two solutions (6) of the homogeneous system (5) are linearly inde¬ 
pendent on [a, b], and if 

jx = x v (t) 

I y = y P (t) 


is any particidar solution of (2) on this interval, then 

\x = CiXft) + c 2 x 2 (t) + x f ,(t) 
\y = c 1 y 1 (t) + c 2 y 2 (t) + y p (t) 


( 14 ) 


is the general solution of (2) on [a, b\. 
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Proof. It suffices to show that if 


X = x(t) 

y = y(0 


is an arbitrary solution of (2), then 


X = x(t)-x p (t) 

y = y(0-y P (0 


is a solution of (5), and this we leave to the reader. 

The above treatment of the linear system (2) shows how its general solution 
(14) can be built up out of simpler pieces. But how do we find these pieces? 
Unfortunately—as in the case of second order linear equations—there does 
not exist any general method that always works. In the next section we dis¬ 
cuss an important special case in which this problem can be solved: that in 
which the coefficients aft) and b,(t), i = 1, 2, are constants. 


Problems 

1. Prove Theorem B. 

2. Finish the proof of Theorem F. 

3. Verify equation (9). 

4. Let the second order linear equation 


d * 1 2 3 4 x dx 

^4 + P(t) — + Q(t)x = 0 

dt 2 w dt 


0 


be reduced to the system 


dx 


% = -Q{t)x-P{t)y. 
dt 


If x,(f) and x 2 (t) are solutions of equation (*), and if 



and 






Systems of First Order Equations 


497 


are the corresponding solutions of (**), show that the Wronskian of the 
former in the sense of Section 15 is precisely the Wronskian of the latter 
in the sense of this section. 


5. (a) Show that 



and 



are solutions of the homogeneous system 
dx 


dt 


= x + 3 y 


dy 
. dt 


3 x + y. 


(b) Show in two ways that the given solutions of the system in (a) are 
linearly independent on every closed interval, and write the gen¬ 
eral solution of this system. 

(c) Find the particular solution 

Jx = x(t) 

|y = y(t) 


of this system for which x(0) = 5 and t/(0) = 1. 
6. (a) Show that 


x = 2e 4f 

y = 3e 4f 


and 



are solutions of the homogeneous system 


dx 
dt 
dy 
. dt 


x + 2 y 
3x + 2 y. 


(b) Show in two ways that the given solutions of the system in (a) are 
linearly independent on every closed interval, and write the gen¬ 
eral solution of this system. 

(c) Show that 


x = 3t-2 
y = -2t + 3 
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is a particular solution of the nonhomogeneous system 

dx _ , „ 

— = x + 2y + f- l 
dt 

< 

— = 3x + 2y - 5f - 2, 


and write the general solution of this system. 

7. Obtain the given solutions of the homogeneous system in Problem 6 

(a) by differentiating the first equation with respect to t and eliminat¬ 
ing y; 

(b) by differentiating the second equation with respect to t and elimi¬ 
nating x. 

8. Use a method suggested by Problem 7 to find the general solution of the 
system 


dx 

dt 

dy 

. dt 


= x + 


= y- 


y 


9. (a) Find the general solution of the system 


dx 
dt 
dy_ 
. dt 


= x 

= y- 


(b) Show that any second order equation obtained from the system in 
(a) is not equivalent to this system, in the sense that it has solu¬ 
tions that are not part of any solution of the system. Thus, although 
higher order equations are equivalent to systems, the reverse is not 
true, and systems are more general. 


56 Homogeneous Linear Systems with Constant Coefficients 

We are now in a position to give a complete explicit solution of the simple system 
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where a y by a 2 , and b 2 are given constants. Some of the problems at the end 
of the previous section illustrate a procedure that can often be applied to this 
case: differentiate one equation, eliminate one of the dependent variables, 
and solve the resulting second order linear equation. The method we now 
describe is based instead on constructing a pair of linearly independent solu¬ 
tions directly from the given system. 

If we recall that the exponential function has the property that its deriva¬ 
tives are constant multiples of the function itself, then (just as in Section 17) 
it is natural to seek solutions of (1) having the form 


J x = Ae mt 
|y = Be mt . 


( 2 ) 


If we substitute (2) into (1) we get 

Arne mt =a 1 Ae mt +b 1 Be mt 
Bme m, =a 2 Ae mt + b 2 Be mt ; 

and dividing by e mt yields the linear algebraic system 

(% - m)A + b 2 B = 0 
a 2 A + ( b 2 - m)B = 0 


in the unknowns A and B. It is clear that (3) has the trivial solution A=B = 0, 
which makes (2) the trivial solution of (1). Since we are looking for nontrivial 
solutions of (1), this is no help at all. However, we know that (3) has non¬ 
trivial solutions whenever the determinant of the coefficients vanishes, i.e., 
whenever 


a 1 -m 

U2 


h 

b 2 -m 


= 0 . 


When this determinant is expanded, we get the quadratic equation 


m 2 - («j + b 2 )m + (a 1 b 2 - a 2 b 2 ) = 0 (4) 

for the unknown m. By analogy with our previous work, we call this the aux¬ 
iliary equation of the system (1). Let m t and m 2 be the roots of (4). If we replace 
m in (3) by m v then we know that the resulting equations have a nontrivial 
solution A 1 By so 


J x = A,e mt 
{y = B 1 e mt 


( 5 ) 
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is a nontrivial solution of the system (1). By proceeding similarly with m 2 , we 
find another nontrivial solution 



( 6 ) 


In order to make sure that we obtain two linearly independent solutions— 
and hence the general solution—it is necessary to examine in detail each of 
the three possibilities for m l and m 2 . 

Distinct real roots. When m 1 and m 2 are distinct real numbers, then (5) and 
(6) are easily seen to be linearly independent (why?) and 


x = CiA 1 e mt + c 2 A 2 e m2t 
y = c 1 B 1 e mt + c 2 B 2 e m2t 


(7) 


is the general solution of (1). 


Example 1. In the case of the system 


. at 



( 8 ) 


(3) is 


(1 - m)A+B=0 


(9) 


4A + (-2 - m) B = 0. 


The auxiliary equation here is 


m 2 +m- 6 = 0 or (m + 3 )(m - 2) = 0, 


so m 1 and m 2 are -3 and 2. With m=- 3, (9) becomes 


4A + B = 0 


4A + B = 0. 


A simple nontrivial solution of this system is A = 1, B =-4, so we have 



( 10 ) 
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as a nontrivial solution of (8). With m = 2, (9) becomes 


-A + B = 0 


4A - 4B = 0, 


and a simple nontrivial solution is A = 1, B = 1. This yields 



( 11 ) 


as another solution of (8); and since it is clear that (10) and (11) are linearly 
independent. 


\x = c 1 e 31 + c 2 e 2t 
{y = -4c 1 e“ 3, +c 2 e 2 ' 


is the general solution of (8). 


Distinct complex roots. If m , and m 2 are distinct complex numbers, then 
they can be written in the form a ± ib where a and b are real numbers and 
b / 0. In this case we expect the A's and B's obtained from (3) to be complex 
numbers, and we have two linearly independent solutions 

jx = AW*** , jx = A;e (a - ii)t 

{ y = B\e (a+ib)t an { y = Bk ( *~ ft) ' . 

However, these are complex-valued solutions, and to extract real-valued 
solutions we proceed as follows. If we express the numbers Al and in the 
standard form A" t = A, + iA 2 and B t = B| + zB 2 , and use Euler's formula 17-(7), 
then the first of the solutions (13) can be written as 


jx = (Ai + iA 2 )e at (cos bt + i sin bt) 
[ y = (Bi + iB 2 )e at (cos bt + istnbt) 


or 


x = e at [(A 1 cos bt - A 2 sin bt) + i(A\ sin bt + A 2 cos bt)] 
y = e at [(B! cos bt - B 2 sin bt) + i(Bi sin bt + B 2 cos bt)]. 


( 14 ) 
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It is easy to see that if a pair of complex-valued functions is a solution of (1), 
in which the coefficients are real constants, then their two real parts and their 
two imaginary parts are real-valued solutions. It follows from this that (14) 
yields the two real-valued solutions 


jx - e at (A 1 cos bt - A 2 sin bt) 
[ y = e at (Bi cos bt - B 2 sin bt) 


and 


jx = e at {Ai sin bt + A 2 cos bt) 
jy = e at (B 1 sin bt + B 2 cos bt). 


(15) 


(16) 


It can be shown that these solutions are linearly independent (we ask the 
reader to prove this in Problem 3), so the general solution in this case is 

jx = e at [ci {Ai cos bt - A 2 sin bt) + c 2 (A 1 sin bt + A 2 cos bt)] 

| y = e‘“[c 1 (B 1 cos bt-B 2 sin bt) + c 2 (B 2 sin bt + B 2 cos bt)]. 

Since we have already found the general solution, it is not necessary to con¬ 
sider the second of the two solutions (13). 


Equal real roots. When m t and m 2 have the same value m, then (5) and (6) are 
not linearly independent and we essentially have only one solution 


x = Ae mt 
y = Be mt . 


(18) 


Our experience in Section 17 would lead us to expect a second linearly inde¬ 
pendent solution of the form 


jx = Ate mt 
jy = Bte ml . 

Unfortunately the matter is not quite as simple as this, and we must actually 
look for a second solution of the form 


jx = (Aj + A 2 t)e mt 

{y = (Bi + B 2 t)e mt , 


( 19 ) 
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so that the general solution is 

| x = c 1 Ae mt +c 2 (A 1 + A 2 t)e ml 

\y = c 1 Be m, +c 2 {B 1 + B 2 t)e mt . 2 ( ’ 

The constants A v A 2 , B v and B 2 are found by substituting (19) into the system 
(1). Instead of trying to carry this through in the general case, we illustrate 
the method by showing how it works in a simple example. 


Example 2. In the case of the system 

[— = 3x - 4y 
_ dt y 

di/ 

[dt J 

(3) is 

(3 - m)A - 4B = 0 
A + (-l-m)B = 0. 

The auxiliary equation is 

m 2 - 2m + 1 = 0 or (m - l) 2 = 0, 

which has equal real roots 1 and 1. With m = 1, (22) becomes 

2h-4B = 0 
A-2B = 0. 

A simple nontrivial solution of this system is A = 2, B = 1, so 

jx = 2e t 

h = e l 


( 21 ) 


( 22 ) 


(23) 


2 The only exception to this statement occurs when a 1 = b 2 =a and ci 2 = b 1 = 0, so that the auxiliary 
equation is m 2 - 2am+a 2 = 0, m = a, and the constants A and B in (18) are completely unre¬ 
stricted. In this case the general solution of (1) is obviously 

fx = c 1 e ml 
\y = c 2 e m ‘. 


and the system is said to be uncoupled (since each equation can be solved independently of the 
other). 
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is a nontrivial solution of (21). We now seek a second linearly indepen¬ 
dent solution of the form 

\x = (Ai+A 2 t)e‘ 

[y = (B 1 +B 2 t)e‘. 

When this is substituted into (21), we obtain 

(Aj + A 2 t + A 2 )e‘ = 3(Ai + A 2 t)e* - 4(B 2 + B 2 t)e‘ 

(Bi + B 2 t + B 2 )e ( — (Ai + A 2 f)t ,t — (Bj + B 2 f)c ( , 

which reduces at once to 

(2 A 2 -4B 2 )t + (2A 1 -A 2 -4B 1 ) = 0 
(A 2 -2B,)f + {Ax -2 Bx-B 2 ) = 0. 

Since these are to be identities in the variable t, we must have 

2A 2 - 4B 2 = 0 2Ax - A 2 - 4 Bx = 0 
A 2 - 2B 2 = 0, Ax - 2Bx -B 2 =0. 


The two equations on the left have A 2 = 2, B 2 = 1 as a simple nontrivial 
solution. With this, the two equations on the right become 

2A 1 -4B 1 = 2 

Ax- 2Bj = l, 

so we may take A t = 1, = 0. We now insert these numbers into (24) and 

obtain 


jx = (l + 2t)e‘ 

\y=te‘ 


as our second solution. It is obvious that (23) and (25) are linearly inde¬ 
pendent, so 


jx = 2 Cxe‘ + c 2 (l + 2t)e* 
[i/ = Cie f + c 2 te‘ 


is the general solution of the system (21). 
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Problems 

1. Use the methods described in this section to find the general solution 
of each of the following systems: 


(a) 


(b) 


(c) 


(d) 


(e) 


(f) 


dx 

— = -3x + 4 y 
dt 


dy 

dt 

dx 

dt 

dy 

dt 

dx 

dt 


= -2x + 3y; 
= 4x - 2y 
= 5x + 2y; 
= 5x + 4y 


dy 

— = -x + y; 

dt J 


dx 

It 

dy 

dt 

dx 

It 

dy 

dt 

dx 

dt 


= 4x-3y 
= 8x-6y; 
= 2x 

= 3 y; 

= -4x-y 


(g) 

(h) 


dy 
. dt 
dx 
dt 

. dt 
dx 
dt 


x-2 y; 
7x + 6y 
2x + 6y; 
-~x-2y 


— = 4x + 5y. 

[dt J 

2. Show that the condition a 1 b ] > 0 is sufficient, but not necessary, for the 
system (1) to have two real-valued linearly independent solutions of the 
form (2). 
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3. Show that the Wronskian of the two solutions (15) and (16) is given by 
tV(0 = (A 1 B 2 - A 2 Bfe 2at , 


and prove that A 1 B 2 - A 2 B 1 / 0. 

4. Show that in formula (20) the constants A 2 and B 2 satisfy the same lin¬ 
ear algebraic system as the constants A and B, and that consequently 
we may put A 2 =A and B 2 = B without any loss of generality 

5. Consider the nonhomogeneous linear system 


— = a 1 (t)x + bft)y + f 1 (t) 
at 

^- = a 2 (t)x + b 2 (t)y + f 2 (t) 
at 


n 


and the corresponding homogeneous system 
dx 

= a 1 (t)x + b 1 (t) V 

d ^- = a 2 (t)x + b 1 {t)y. 

L at 

(a) If 

fx = Xi (t) [ x = x 2 (t) 

\ ) and \ 

[y = yi(0 [y = yi{t) 


are linearly independent solutions of (**), so that 

fx = C 1 Xi(t) + C 2 X 2 (t) 

|y = ciyi(t) + c 2 y 2 (t) 

is its general solution, show that 

Jx = Vi(t)Xi(t) + v 2 (t)x 2 (t) 

\y = v 1 (t)y 1 (t) + v 2 (t)y 2 (t) 

will be a particular solution of (*) if the functions vft) and v 2 (t) sat¬ 
isfy the system 

v\x x + » 2 x 2 = f\ 
v' l y 1 + v' 2 y 2 = f 2 . 


This technique for finding particular solutions of nonhomogeneous 
linear systems is called the method of variation of parameters. 
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(b) Apply the method outlined in (a) to find a particular solution of the 
nonhomogeneous system 

— = x + t/-5f + 2 
dt J 

< 

— = 4x-2i/-8f-8, 

[dt 

whose corresponding homogeneous system is solved in Example 1. 


57 Nonlinear Systems. Volterra's Prey-Predator Equations 

Everyone knows that there is a constant struggle for survival among differ¬ 
ent species of animals living in the same environment. One kind of animal 
survives by eating another; a second, by developing methods of evasion to 
avoid being eaten; and so on. 

As a simple example of this universal conflict between the predator and 
its prey, let us imagine an island inhabited by foxes and rabbits. The foxes 
eat rabbits, and the rabbits eat clover. We assume that there is so much clo¬ 
ver that the rabbits always have an ample supply of food. When the rabbits 
are abundant, then the foxes flourish and their population grows. When the 
foxes become too numerous and eat too many rabbits, they enter a period 
of famine and their population begins to decline. As the foxes decrease, the 
rabbits become relatively safe and their population starts to increase again. 
This triggers a new increase in the fox population, and as time goes on we 
see an endlessly repeated cycle of interrelated increases and decreases in the 
populations of the two species. These fluctuations are represented graphi¬ 
cally in Figure 70, where the sizes of the populations are plotted against time. 



FIGURE 70 
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Problems of this kind have been studied by both mathematicians and biol¬ 
ogists, and it is quite interesting to see how the mathematical conclusions we 
shall develop confirm and extend the intuitive ideas arrived at in the preced¬ 
ing paragraph. In discussing the interaction between the foxes and the rab¬ 
bits, we shall follow the approach of Volterra, who initiated the quantitative 
treatment of such problems. 3 

If x is the number of rabbits at time f, then we should have 

— = ax, a> 0, 
dt 

as a consequence of the unlimited supply of clover, if the number y of foxes 
is zero. It is natural to assume that the number of encounters per unit time 
between rabbits and foxes is jointly proportional to x and y. If we further 
assume that a certain proportion of these encounters result in a rabbit being 
eaten, then we have 


dx , 

— = ax - bxy, 
dt 


a and b > 0. 


In the same way 


dy_ 


dt 


-cy+dxy, 


c and d > 0; 


for in the absence of rabbits the foxes die out, and their increase depends on 
the number of their encounters with rabbits. We therefore have the following 
nonlinear system describing the interaction of these two species: 


dx 

dt 

. dt 


x(a-by) 

-y(c-dx). 


( 1 ) 


3 Vito Volterra (1860-1940) was an eminent Italian mathematician. His early work on integral 
equations (together with that of Fredholm and Hilbert) began the full-scale development of 
linear analysis that dominated so much of mathematics during the first half of the twentieth 
century. His vigorous excursions in later life into mathematical biology enriched both mathe¬ 
matics and biology. For further details, see his Lecons sur la theorie mathematique de la lutte pour 
la vie, Gauthier-Villars, Paris, 1931; or A. J. Lotka, Elements of Mathematical Biology, pp. 88-94, 
Dover, New York, 1956. A modern discussion, with the Hudson's Bay Company data on the 
numbers of lynx and hares in Canada from 1847 to 1903, can be found in E. R. Leigh, "The 
Ecological Role of Volterra's Equations," in Some Mathematical Problems in Biology, American 
Mathematical Society, Providence, R.I., 1968. 
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Equations (1) are called Volterra's prey-predator equations. Unfortunately this 
system cannot be solved in terms of elementary functions. On the other 
hand, if we think of its unknown solution 

Jx = x(t) 

|y = y(f) 

as constituting the parametric equations of a curve in the xty-plane, then we 
can find the rectangular equation of this curve. On eliminating t in (1) by 
division, and separating the variables, we obtain 

(a-by)dy _ ( c-dx)dx 
y x 


Integration now yields 

a log y -by = -c log x+dx + log K 


or 


ya e -by _ Kx~ c e dx , (2) 

where the constant K is given by 

K = x c 0 y a 0 e- dx °- hvo 

in terms of the initial values of x and y. 

Although we cannot solve (2) for either x or y, we can determine points on 
the curve by an ingenious method due to Volterra. To do this, we equate the 
left and right sides of (2) to new variables z and w, and then plot the graphs 
C, and C 2 of the functions 


z -ya e -by and w-Kxr c e ix (3) 

as shown in Figure 71. Since z-vo, we are confined in the third quadrant to 
the dotted line L. To the maximum value of z given by the point A on C v 
there corresponds one y and—via M on L and the corresponding points A 
and A" on C 2 —two x's, and these determine the bounds between which x 
may vary. Similarly, the minimum value of w given by B on C 2 leads to N on 
L and hence to B' and B" on C, and these points determine the bounds for 
y. In this way we find the points P, P 2 and Q v Q 2 on the desired curve C 3 . 
Additional points are easily found by starting on L at a point R anywhere 
between M and N and projecting up to Cj and over to C 3 , and then over to 
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FIGURE 71 


C 2 and up to C 3 , as indicated in Figure 71. It is clear that changing the value 
of K raises or lowers the point B, and this expands or contracts the curve C 3 . 
Accordingly, when K is given various values, we obtain a family of ovals 
about the point S, which is all there is of C 3 when the minimum value of w 
equals the maximum value of z. 

We next show that as t increases, the corresponding point (x, y) on C 3 moves 
around the curve in a counterclockwise direction. To see this, we begin by 
noting that equations (1) give the horizontal and vertical components of the 
velocity of this point. A simple calculation based on formulas (3) shows that 
the point S has coordinates x-c/d, y=a/b. When x < c/d, it follows from the 
second equation of (1) that dy/dt is negative, so our point on C 3 moves down 
as it traverses the arc Q 2 P 2 Q V Similarly, it moves up along the arc Q 1 P 2 Q 2 , so 
the assertion is proved. 

Finally, we use the fox-rabbit problem to illustrate the important method of 
linearization. First, we observe that if the rabbit and fox populations are 

x = ^ and y= a (4) 

d b 

then the system (1) is satisfied and we have dx/dt = 0 and dy/dt - 0, so there are 
no increases or decreases in x or y. The populations (4) are called equilibrium 
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popidations, for x and y can maintain themselves indefinitely at these con¬ 
stant levels. It is obvious that this is the special case in which the minimum 
of w equals the maximum of z, so that the oval C 3 reduces to the point S. If we 
now return to the general case and put 

x = - + X and y = — + Y, 
d 

then X and Y can be thought of as the deviations of x and y from their equi¬ 
librium values. An easy calculation shows that if x and y in (1) are replaced 
by X and Y [which amounts to translating the point (c/d, a/b) to the origin] 
then (1) becomes 


' dX 

hr 


- — Y-bXY 


d 

dY 

ad 


— X + dXY. 

dt 

b 


( 5 ) 


We now "linearize" by assuming that if X and Y are small, then the XY terms 
in (5) can be discarded without serious error. This assumption amounts to 
little more than a hope, but it does simplify (5) to a linear system 


dX _ be y 
dt d 
dY _ ad 


( 6 ) 


It is easy to find the general solution of (6), but it is even easier to eliminate t 
by division and obtain 


dY _ ad 2 X 
dX~ IfcY' 


whose solution is immediately seen to be 


ad 2 X 2 +b 2 cY 2 =C 2 . 


This is a family of ellipses surrounding the origin in the XY-plane. Since 
ellipses are qualitatively similar to the ovals of Figure 71, we have reasonable 
grounds for hoping that (6) is an acceptable approximation to (5). 

We trust that the reader agrees that the fox-rabbit problem is interesting for 
its own sake. Beyond this, however, we have come to appreciate the fact that 
nonlinear systems present us with problems of a different nature from those 
we have considered before. In studying a system like (1), we have learned to 
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direct our attention to the behavior of solutions near points in the xy-plane at 
which the right sides both vanish; we have seen why periodic solutions (i.e., 
those that yield simple closed curves like C 3 in Figure 71) are important and 
desirable; and we have a hint of a method for studying nonlinear systems by 
means of linear systems that approximate them. In the next chapter we shall 
study nonlinear systems more fully, and each of these themes will be worked 
out in greater detail and generality. 


Problems 

1. Eliminate y from the system (1) and obtain the nonlinear second order 
equation satisfied by the function x(t). 

2. Show that d * 1 2 y/dt 2 > 0 whenever dx/dt > 0. What is the meaning of this 
result in terms of Figure. 70? 




Chapter 11 

Nonlinear Equations 


58 Autonomous Systems. The Phase Plane and Its Phenomena 

There have been two major trends in the historical development of differ¬ 
ential equations. The first and oldest is characterized by attempts to find 
explicit solutions, either in closed form—which is rarely possible—or in 
terms of power series. In the second, one abandons all hope of solving equa¬ 
tions in any traditional sense, and instead concentrates on a search for quali¬ 
tative information about the general behavior of solutions. We applied this 
point of view to linear equations in Chapter 4. The qualitative theory of non¬ 
linear equations is totally different. It was founded by Poincare around 1880, 
in connection with his work in celestial mechanics, and since that time has 
been the object of steadily increasing interest on the part of both pure and 
applied mathematicians. 1 

The theory of linear differential equations has been studied deeply and 
extensively for the past 200 years, and is a fairly complete and well-rounded 
body of knowledge. However, very little of a general nature is known about 
nonlinear equations. Our purpose in this chapter is to survey some of the 
central ideas and methods of this subject, and also to demonstrate that it 
presents a wide variety of interesting and distinctive new phenomena that 
do not appear in the linear theory. The reader will be surprised to find that 
most of these phenomena can be treated quite easily without the aid of 
sophisticated mathematical machinery, and in fact require little more than 
elementary differential equations and two-dimensional vector algebra. 

Why should one be interested in nonlinear differential equations? The 
basic reason is that many physical systems—and the equations that describe 
them—are simply nonlinear from the outset. The usual linearizations are 
approximating devices that are partly confessions of defeat in the face of the 
original nonlinear problems and partly expressions of the practical view that 
half a loaf is better than none. It should be added at once that there are many 
physical situations in which a linear approximation is valuable and adequate 


1 See Appendix A for a general account of Poincare's work in mathematics and science. 
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for most purposes. This does not alter the fact that in many other situations 
linearization is unjustified. 2 

It is quite easy to give simple examples of problems that are essentially 
nonlinear. For instance, if x is the angle of deviation of an undamped pen¬ 
dulum of length a whose bob has mass m, then we saw in Section 5 that its 
equation of motion is 


d 2 x 

dt 2 


+ —sinx 
a 


0 ; 


( 1 ) 


and if there is present a damping force proportional to the velocity of the 
bob, then the equation becomes 


d 2 x 
dt 2 


+ 


c dx 

-h 

m dt 


Q 

— sin x = 0. 
a 


( 2 ) 


In the usual linearization we replace sin x by x, which is reasonable for small 
oscillations but amounts to a gross distortion when x is large. An example of 
a different type can be found in the theory of the vacuum tube, which leads 
to the important van der Pol equation 

d x , t .. dx n . 

— r +p(x -1)—+ x = 0. (3) 

dr dt 

It will be seen later that each of these nonlinear equations has interesting 
properties not shared by the others. 

Throughout this chapter we shall be concerned with second order nonlin¬ 
ear equations of the form 


d 2 x 

It 2 



( 4 ) 


which includes equations (1), (2), and (3) as special cases. If we imagine a 
simple dynamical system consisting of a particle of unit mass moving on 
the x-axis, and if/(x, dx/dt) is the force acting on it, then (4) is the equation of 
motion. The values of x (position) and dx/dt (velocity), which at each instant 
characterize the state of the system, are called its phases, and the plane of the 
variables x and dx/dt is called the phase plane. If we introduce the variable 
y = dx/dt, then (4) can be replaced by the equivalent system 


2 It has even been suggested by Einstein that since the basic equations of physics are nonlinear, 
all of mathematical physics will have to be done over again. If his crystal ball was clear on 
the day he said this, the mathematics of the future will certainly be very different from that 
of the past and present. 
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dx 



( 5 ) 


We shall see that a good deal can be learned about the solutions of (4) 
by studying the solutions of (5). When t is regarded as a parameter, then 
in general a solution of (5) is a pair of functions x(t ) and y(t) defining a 
curve in the xy-plane, which is simply the phase plane mentioned above. 
We shall be interested in the total picture formed by these curves in the 
phase plane. 

More generally, we study systems of the form 



( 6 ) 


where F and G are continuous and have continuous first partial derivatives 
throughout the plane. A system of this kind, in which the independent vari¬ 
able t does not appear in the functions F and G on the right, is said to be 
autonomous. We now turn to a closer examination of the solutions of such a 
system. 

It follows from our assumptions and Theorem 54-A that if t Q is any num¬ 
ber and {x 0 ,y 0 ) is any point in the phase plane, then there exists a unique 
solution 



( 7 ) 


of (6) such that x(t 0 )-x 0 and y(t 0 )-y 0 . If x(f) and y(t ) are not both constant 
functions, then (7) defines a curve in the phase plane called a path of the sys¬ 
tem. 3 It is clear that if (7) is a solution of (6), then 


X = x(t + c) 

y = y(t+c) 


( 8 ) 


is also a solution for any constant c. Thus each path is represented by 
many solutions, which differ from one another only by a translation of 


3 The terms trajectory and characteristic are used by some writers. 
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the parameter. Also, it is quite easy to prove (see Problem 2) that any path 
through the point (x 0 ,y Q ) must correspond to a solution of the form (8). It fol¬ 
lows from this that at most one path passes through each point of the phase 
plane. Furthermore, the direction of increasing t along a given path is the 
same for all solutions representing the path. A path is therefore a directed 
curve, and in our figures we shall use arrows to indicate the direction in 
which the path is traced out as t increases. 

The above remarks show that in general the paths of (6) cover the entire 
phase plane and do not intersect one another. The only exceptions to this 
statement occur at points (x 0 ,y 0 ) where both F and G vanish: 

Hx 0 ,y 0 ) = 0 and G(x 0 ,y 0 ) = 0. 

These points are called critical points, and at such a point the unique solu¬ 
tion guaranteed by Theorem 54-A is the constant solution x = x 0 and y = y 0 . 
A constant solution does not define a path, and therefore no path goes 
through a critical point. In our work we will always assume that each critical 
point (x 0 ,y 0 ) is isolated, in the sense that there exists a circle centered on (x 0 ,y 0 ) 
that contains no other critical point. 

In order to obtain a physical interpretation of critical points, let us consider 
the special autonomous system (5) arising from the dynamical equation (4). 
In this case a critical point is a point (x 0 ,0) at which y = 0 and f(x 0 , 0) = 0; that 
is, it corresponds to a state of the particle's motion in which both the velocity 
dx/dt and the acceleration dy/dt = d 2 x/dt 2 vanish. This means that the particle 
is at rest with no force acting on it, and is therefore in a state of equilibrium. 4 
It is obvious that the states of equilibrium of a physical system are among its 
most important features, and this accounts in part for our interest in critical 
points. 

The general autonomous system (6) does not necessarily arise from any 
dynamical equation of the form (4). What sort of physical meaning can be 
attached to the paths and critical points in this case? Here it is convenient to 
consider Figure 72 and the two-dimensional vector field defined by 

V(x,y) = F(x,y) i + G(x,y)j, 

which at a typical point P = ( x,y ) has horizontal component F(x,y) and verti¬ 
cal component G(x,y). Since dx/dt = F and dy/dt = G, this vector is tangent to 
the path at P and points in the direction of increasing t. If we think of t as 
time, then V can be interpreted as the velocity vector of a particle moving 
along the path. We can also imagine that the entire phase plane is filled with 
particles, and that each path is the trail of a moving particle preceded and 
followed by many others on the same path and accompanied by yet others 
on nearby paths. This situation can be described as a two-dimensional fluid 


4 For this reason, some writers use the term equilibrium point instead of critical point. 



Nonlinear Equations 


517 



FIGURE 72 


motion ; and since the system (6) is autonomous, which means that the vector 
V(x,y) at a fixed point (x,y) does not change with time, the fluid motion is sta¬ 
tionary. The paths are the trajectories of the moving particles, and the critical 
points Q, R, and S are points of zero velocity where the particles are at rest 
(i.e., stagnation points of the fluid motion). 

The most striking features of the fluid motion illustrated in Figure 72 are: 

(a) the critical points; 

(b) the arrangement of the paths near critical points; 

(c) the stability or instability of critical points, that is, whether a particle 
near such a point remains near or wanders off into another part of 
the plane; 

(d) closed paths (like C in the figure), which correspond to periodic 
solutions. 

These features constitute a major part of the phase portrait (or overall pic¬ 
ture of the paths) of the system (6). Since in general nonlinear equations and 
systems cannot be solved explicitly, the purpose of the qualitative theory 
discussed in this chapter is to discover as much as possible about the phase 
portrait directly from the functions F and G. To gain some insight into the 
sort of information we might hope to obtain, observe that if x(t) is a periodic 
solution of the dynamical equation (4), then its derivative y(t) = dx/dt is also 
periodic and the corresponding path of the system (5) is therefore closed. 
Conversely, if any path of (5) is closed, then (4) has a periodic solution. As a 
concrete example of the application of this idea, we point out that the van der 
Pol equation—which cannot be solved—can nevertheless be shown to have a 
unique periodic solution (if g > 0) by showing that its equivalent autonomous 
system has a unique closed path. 
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Problems 

1. Derive equation (2) by applying Newton's second law of motion to the 
bob of the pendulum. 

2. Let (x 0 ,y 0 ) be a point in the phase plane. If xft) yft) and x 2 (t), y 2 (t) are 
solutions of (6) such that xftf = x 0l yft^) -y 0 and x 2 (f 2 ) =x 0 , y 2 (t 2 )-y 0 for 
suitable t 1 and f 2 , show that there exists a constant c such that 

xft + c) = x 2 (t) and y 1 (t+c)=y 2 (t). 

3. Describe the relation between the phase portraits of the systems 


f eF <^> 


and 




4. Describe the phase portrait of each of the following systems: 
dx 


(a) 


, =0 
dt 

— = 0 ; 

dt 


(b) 


dx 

— = x 

dt 

— = 0 ; 

dt 


(c) 


= 1 


dx 
dt 

o. 

dt 


(d) 


dx 

dt 

dy_ 

dt 


- = -x 


= -y- 


5. The critical points and paths of equation (4) are by definition those of 
the equivalent system (5). Find the critical points of equations (1), (2), 
and (3). 
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6. Find the critical points of 



dt 



7. Find all solutions of the nonautonomous system 


dx 

dt 


= x 


dy_ 
. dt 


and sketch (in the xy-plane) some of the curves defined by these 
solutions. 


59 Types of Critical Points. Stability 

Consider an autonomous system 



( 1 ) 


We assume, as usual, that the functions F and G are continuous and have 
continuous first partial derivatives throughout the xy-plane. The critical 
points of (1) can be found, at least in principle, by solving the simultane¬ 
ous equations F(x,y) = 0 and G(x,y) = 0. There are four simple types of criti¬ 
cal points that occur quite frequently, and our purpose in this section is to 
describe them in terms of the configurations of nearby paths. First, however, 
we need two definitions. 

Let (x 0 ,y 0 ) be an isolated critical point of (1). If C = [x(f),y(f)] is a path of (1), 
then we say that C approaches (x 0 ,y 0 ) as t °o if 
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limx(f) = x 0 and limy(f) = y 0 . 5 (2) 

t-> 00 t-> CO 

Geometrically, this means that if P = (x,y) is a point that traces out C in accor¬ 
dance with the equations x = x(t) and y = y(t), then P -* (x 0 ,y 0 ) as t -*■ If it is 
also true that 


x(f)-x 0 


( 3 ) 


exists, or if the quotient in (3) becomes either positively or negatively infi¬ 
nite as t -*■ °°, then we say that C enters the critical point (x 0 ,y 0 ) as t -> 
The quotient in (3) is the slope of the line joining (x 0 ,y 0 ) and the point P with 
coordinates x(t) and y(f), so the additional requirement means that this line 
approaches a definite direction as t -* In the above definitions, we may also 
consider limits as t -* It is clear that these properties are properties of the 
path C, and do not depend on which solution is used to represent this path. 

It is sometimes possible to find explicit solutions of the system (1), and 
these solutions can then be used to determine the paths. In most cases, how¬ 
ever, to find the paths it is necessary to eliminate t between the two equa¬ 
tions of the system, which yields 

dy _ G(x,y) (4) 

dx F(x,y) 

This first order equation gives the slope of the tangent to the path of (1) that 
passes through the point (x,y), provided that the functions F and G are not 
both zero at this point. In this case, of course, the point is a critical point 
and no path passes through it. The paths of (1) therefore coincide with the 
one-parameter family of integral curves of (4), and this family can often be 
obtained by the methods of Chapter 2. It should be noted, however, that 
while the paths of (1) are directed curves, the integral curves of (4) have no 
direction associated with them. Each of these techniques for determining the 
paths will be illustrated in the examples below. 

We now give geometric descriptions of the four main types of critical 
points. In each case we assume that the critical point under discussion is the 
origin O = (0,0). 


Nodes. A critical point like that in Figure 73 is called a node. Such a point is 
approached and also entered by each path as t -* °° (or as t -> -°°). For the 
node shown in Figure 73, there are four half-line paths, AO, BO, CO, and 
DO, which together with the origin make up the lines AB and CD. All other 


5 It can be proved that if (2) is true for some solution x(t), y(t), then ( x 0 , y 0 ) is necessarily a critical 
point. See F. G. Tricomi, Differential Equations, p. 47, Blackie, Glasgow, 1961. 
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FIGURE 73 


paths resemble parts of parabolas, and as each of these paths approaches O 
its slope approaches that of the line AB. 


Example 1. Consider the system 

dx 
dt 
dy_ 
_ dt 


= X 

= -x + 2 y. 


( 5 ) 


It is clear that the origin is the only critical point, and the general solu¬ 
tion can be found quite easily by the methods of Section 56: 


X = CjC 

y = c 2 e l + c 2 e 2t 


( 6 ) 


When c 1 = 0, we have x = 0 and y = c 2 e 2t . In this case the path (Figure 74) is 
the positive y-axis when c 2 > 0, and the negative y-axis when c 2 < 0, and 
each path approaches and enters the origin as t -> When c 2 = 0, we 
have x=c l e t and y=c 2 e l . This path is the half-line y=x, x> 0, when c x > 0, 
and the half-line y = x, x < 0, when c 2 < 0, and again both paths approach 
and enter the origin as t -> When both c 2 and c 2 are ^ 0, the paths 
lie on the parabolas y = x + (c 2 /c 2 )x 2 , which go through the origin with 
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FIGURE 74 


slope 1. It should be understood that each of these paths consists of only 
part of a parabola, the part with x > 0 if c 1 > 0, and the part with x < 0 
if c 1 < 0. Each of these paths also approaches and enters the origin as 
t —> -o°; this can be seen at once from (6). If we proceed directly from (5) 
to the differential equation 


dy _ -x+ 2y ' 
dx x 

giving the slope of the tangent to the path through ( x,y ) [provided ( x,y ) 
^ (0,0)], then on solving (7) as a homogeneous equation, we find that 
y=x + cx 2 . This procedure yields the curves on which the paths lie (except 
those on the \j axis), but gives no information about the manner in which 
the paths are traced out. It is clear from this discussion that the critical 
point (0,0) of the system (5) is a node. 


Saddle points. A critical point like that in Figure 75 is called a saddle point. It 
is approached and entered by two half-line paths AO and BO as t -> and 
these two paths lie on a line AB. It is also approached and entered by two 
half-line paths CO and DO at t -» -°°, and these two paths lie on another line 
CD. Between the four half-line paths there are four regions, and each con¬ 
tains a family of paths resembling hyperbolas. These paths do not approach 
O as t -> °° or as t -> but instead are asymptotic to one or another of the 
half-line paths as t °o and as t 
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FIGURE 75 


Centers. A center (sometimes called a vortex) is a critical point that is sur¬ 
rounded by a family of closed paths. It is not approached by any path as 
t —» °° or as t —> — 


Example 2. The system 


dx 


dy_ 

_ dt 


=-y 


= X 


( 8 ) 


has the origin as its only critical point, and its general solution is 


[ x = -Ci sin t + c 2 cos t 
[y = CiCOSf + C 2 sinf. 


( 9 ) 


The solution satisfying the conditions x(0) = 1 and y(0) - 0 is clearly 


x = cos t 
y = sinf; 


( 10 ) 
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and the solution determined by x(0) = 0 and y(0) = -1 is 


x = sinf = cos| t- — 


y = —cost = sin| f- — 


( 11 ) 


These two different solutions define the same path C (Figure 76), which 
is evidently the circle x 2 +y 2 = l. Both (10) and (11) show that this path is 
traced out in the counterclockwise direction. If we eliminate t between 
the equations of the system, we get 

dy _ x 
dx y 

whose general solution x 2 +y 2 =c 2 yields all the paths (but without their 
directions). It is obvious that the critical point (0,0) of the system (8) is a 
center. 


Spirals. A critical point like that in Figure 77 is called a spiral (or sometimes 
a focus). Such a point is approached in a spiral-like manner by a family of 
paths that wind around it an infinite number of times as t -* °° (or as t -* 



FIGURE 76 
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FIGURE 77 


Note particularly that while the paths approach O, they do not enter it. That 
is, a point P moving along such a path approaches O as t -* °° (or as t -> 
but the line OP does not approach any definite direction. 


Example 3. If a is an arbitrary constant, then the system 


dx 

— = ax-y 
dt 

dy 

—^ = x +mi 
[dt J 


( 12 ) 


has the origin as its only critical point (why?). The differential equation 
of the paths. 


dy _x +ay 
dx ax-y 


(13) 


is most easily solved by introducing polar coordinates r and 0 defined by 
x = r cos 0 and y = r sin 0. Since 

r 2 =x 2 + y 2 and 0 = tan“ 1 ^, 

X 
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we see that 


dr 
r — 
dx 


x + y 


dy_ 

dx 


and 


2 dO 

r — 
dx 



-y- 


With the aid of these equations, (13) can easily be written in the very 
simple form 


dr 

ho 


= ar, 


so 


r = ce a6 (14) 

is the polar equation of the paths. The two possible spiral configurations 
are shown in Figure 78 and the direction in which these paths are tra¬ 
versed can be seen from the fact that dx/dt = -y when x = 0. If a = 0, then 
(12) collapses to (8) and (14) becomes r = c, which is the polar equation of 
the family x 2 +y 2 =c 2 of all circles centered on the origin. This example 
therefore generalizes Example 2; and since the center shown in Figure 76 
stands on the borderline between the spirals of Figure 78, a critical point 
that is a center is often called a borderline case. We will encounter other 
borderline cases in the next section. 


We now introduce the concept of stability as it applies to the critical points of 
the system (1). 

It was pointed out in the previous section that one of the most important 
questions in the study of a physical system is that of its steady states. However, 
a steady state has little physical significance unless it has a reasonable degree 



y 



X 


a < 0 


FIGURE 78 
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m • 


FIGURE 79 


of permanence, i.e., unless it is stable. As a simple example, consider the pen¬ 
dulum of Figure 79. There are two steady states possible here: when the bob 
is at rest at the highest point, and when the bob is at rest at the lowest point. 
The first state is clearly unstable, and the second is stable. We now recall 
that a steady state of a simple physical system corresponds to an equilibrium 
point (or critical point) in the phase plane. These considerations suggest in a 
general way that a small disturbance at an unstable equilibrium point leads 
to a larger and larger departure from this point, while the opposite is true at 
a stable equilibrium point. 

We now formulate these intuitive ideas in a more precise way. Consider 
an isolated critical point of the system (1), and assume for the sake of con¬ 
venience that this point is located at the origin O = (0,0) of the phase plane. 
This critical point is said to be stable if for each positive number R there 
exists a positive number r < R such that every path which is inside the cir¬ 
cle x 2 + y 2 =r 2 for some t = t 0 remains inside the circle x 2 +y 2 = R 2 for all t > t 0 
(Figure 80). Loosely speaking, a critical point is stable if all paths that get 
sufficiently close to the point stay close to the point. Further, our critical 
point is said to be asymptotically stable if it is stable and there exists a circle 
x 2 + y 2 = r 2 such that every path which is inside this circle for some t-t 0 
approaches the origin as t -* Finally, if our critical point is not stable, then 
it is called unstable. 

As examples of these concepts, we point out that the node in Figure 74, the 
saddle point in Figure 75, and the spiral on the left in Figure 78 are unstable, 
while the center in Figure 76 is stable but not asymptotically stable. The node 
in Figure 73, the spiral in Figure 77, and the spiral on the right in Figure 78 
are asymptotically stable. 
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FIGURE 80 


Problems 


1. For each of the following nonlinear systems: (i) find the critical points; 
(ii) find the differential equation of the paths; (iii) solve this equation to 
find the paths; and (iv) sketch a few of the paths and show the direction 
of increasing t. 


(a) 


(b) 


(c) 


dx 
dt 
dy_ 
„ dt 

dx 
dt 
dy 
„ dt 

dx 

dt 

dy 


_ dt 


y(x 2 + 1) 

2 xy 2 ; 

y(x 2 + 1) 

-x(x 2 + 1); 

e y cosx; 
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(d) 


dx 

dt 

dy_ 

At 


- -X 

- 2x 2 y 2 - 


2 . 


Each of the following linear systems has the origin as an isolated criti¬ 
cal point, (i) Find the general solution, (ii) Find the differential equation 
of the paths, (iii) Solve the equation found in (ii) and sketch a few of the 
paths, showing the direction of increasing t. (iv) Discuss the stability of 
the critical point. 


(a) 


dx 

dt 

dy_ 

dt 


x 

-y ; 


(b) 


dx 

dt 

dy_ 

, dt 


-x 


- 2 y ; 


(C) 


dx 

dt 

dy 


. dt 


4 y 

-X. 


3. Sketch the phase portrait of the equation d 2 x/dt 2 -2x 3 , and show that it 
has an unstable isolated critical point at the origin. 


60 Critical Points and Stability for Linear Systems 

Our goal in this chapter is to learn as much as we can about nonlinear dif¬ 
ferential equations by studying the phase portraits of nonlinear autonomous 
systems of the form 


f -*■*> 

One aspect of this is the problem of classifying the critical points of such a 
system with respect to their nature and stability. It will be seen in Section 62 
that under suitable conditions this problem can be solved for a given non¬ 
linear system by studying a related linear system. We therefore devote this 
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section to a complete analysis of the critical points of linear autonomous 
systems. 

We consider the system 


dx , 

— = fljx + bpj 

at 

^ = a 2 x + b 2 y, 


( 1 ) 


which has the origin (0,0) as an obvious critical point. We assume throughout 
this section that 


«i 

«2 



( 2 ) 


so that (0,0) is the only critical point. It was proved in Section 56 that (1) has a 
nontrivial solution of the form 


J x = Ae mt 
[y = Be mt 


whenever m is a root of the quadratic equation 

m 2 - (rtj + b^)m + ( af 2 ~ «2&i) = 0/ (3) 

which is called the auxiliary equation of the system. Observe that condition (2) 
implies that zero cannot be a root of (3). 

Let m 1 and m 2 be the roots of (3). We shall prove that the nature of the 
critical point (0,0) of the system (1) is determined by the nature of the num¬ 
bers m j and m 2 . It is reasonable to expect that three possibilities will occur, 
according as m l and m 2 are real and distinct, real and equal, or conjugate 
complex. Unfortunately the situation is a little more complicated than this, 
and it is necessary to consider five cases, subdivided as follows. 

Major cases: 

Case A. The roots in, and m 2 are real, distinct, and of the same sign (node). 
Case B. The roots m 1 and m 2 are real, distinct, and of opposite signs (saddle 
point). 

Case C. The roots m, and m 2 are conjugate complex but not pure imaginary 
(spiral). 

Borderline cases: 

Case D. The roots m 1 and m 2 are real and equal (node). 

Case E. The roots m 1 and m 2 are pure imaginary (center). 
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The reason for the distinction between the major cases and the borderline 
cases will become clear in Section 62. For the present it suffices to remark 
that while the borderline cases are of mathematical interest they have lit¬ 
tle significance for applications, because the circumstances defining them 
are unlikely to arise in physical problems. We now turn to the proofs of the 
assertions in parentheses. 


Case A. If the roots m 1 and m 2 are real, distinct, and of the same sign, then 
the critical point (0,0) is a node. 

Proof. We begin by assuming that m l and m 2 are both negative, and we 
choose the notation so that m 1 < m 2 < 0. By Section 56, the general solution of 
(1) in this case is 


jx = c 1 A 1 e mit + c 2 A 2 e m2t 
\y = c 1 B 1 e mt + c 2 B 2 e m2t , 

where the A's and B's are definite constants such that BJA X / B 2 /A 2 , and 
where the c's are arbitrary constants. When c 2 = 0, we obtain the solutions 


jx = CiA 1 e mt 

\y = c 1 B 1 e mit , 

and when c 1 = 0, we obtain the solutions 


( 5 ) 


jx — c 2 A 2 e mit 
[y = c 2 B 2 e"‘ 2t . 

For any c, > 0, the solution (5) represents a path consisting of half of the line 
A x y = B 1 x with slope B 1 /A 1 ; and for any q < 0, it represents a path consist¬ 
ing of the other half of this line (the half on the other side of the origin). 
Since rn ] < 0, both of these half-line paths approach (0,0) as f -»■ °°; and since 
y/x = B x /A v both enter (0,0) with slope 6,/h, (Figure 81). In exactly the same 
way, the solutions (6) represent two half-line paths lying on the line A 2 ij = B 2 x 
with slope B 2 /A 2 . These two paths also approach (0,0) as t -* °°,and enter it 
with slope B 2 /A 2 . 

If q # 0 and c 2 # 0, the general solution (4) represents curved paths. Since 
, < 0 and m 2 < 0, these paths also approach (0,0) as f Furthermore, since 
;«j - m 2 < 0 and 


y _ CiB x e mit + c 2 B 2 e mi ‘ _ (c 1 B 1 /c 2 )e im - m2)t + B 2 
x ~ c 1 A 1 e mt +c 2 A 2 e m2t _ (c 1 A 1 /c 2 )e {m - m2)t + A 2 ' 
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FIGURE 81 


it is clear that y/x -> B 2 /A 2 as t so all of these paths enter (0,0) with slope 
B 2 /A 2 . Figure 81 presents a qualitative picture of the situation. It is evident 
that our critical point is a node, and that it is asymptotically stable. 

If m 1 and m 2 are both positive, and if we choose the notation so that m 1 > 
m 2 > 0, then the situation is exactly the same except that all the paths now 
approach and enter (0,0) as t -+-<= 0 . The picture of the paths given in Figure 81 
is unchanged except that the arrows showing their directions are all reversed. 
We still have a node, but now it is unstable. 

Case B. If the roots m 1 and m 2 are real, distinct, and of opposite signs, then 
the critical point (0,0) is a saddle point. 

Proof. We may choose the notation so that m 1 < 0 < m 2 . The general solu¬ 
tion of (1) can still be written in the form (4), and again we have particular 
solutions of the forms (5) and (6). The two half-line paths represented by (5) 
still approach and enter (0,0) as t -* °°, but this time the two half-line paths 
represented by (6) approach and enter (0,0) as t ->■ If c x # 0 and c 2 / 0, the 
general solution (4) still represents curved paths, but since m l < 0 < m 2 , none 
of these paths approaches (0,0) as t -> °° or t -> Instead, as t °°, each of 
these paths is asymptotic to one of the half-line paths represented by (6); and 
as t -> - 00 , each is asymptotic to one of the half-line paths represented by (5). 
Figure 82 gives a qualitative picture of this behavior. In this case the critical 
point is a saddle point, and it is obviously unstable. 

Case C. If the roots m v and m 2 are conjugate complex but not pure imaginary, 
then the critical point (0,0) is a spiral. 
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FIGURE 82 


Proof. In this case we can write m 1 and m 2 in the form a ± ib where a and b are 
nonzero real numbers. Also, for later use, we observe that the discriminant 
D of equation (3) is negative: 


D-(a 1 + bfj 1 - A(a l b 2 - a 2 b^) 

= (flj - b 2 ) 2 + 4fl 2 bi < 0. (7) 

By Section 56, the general solution of (1) in this case is 


jx = e at [c 1 (A 1 cos bt - A 2 sin bt) + c 2 (Ai sin bt + A 2 cos bt)] 
jy = e^lcfBi cos bt - B 2 sin bt) + c 2 (B 1 sin bt + B 2 cos bt)], 

where the A's and B’s are definite constants and the c's are arbitrary 
constants. 

Let us first assume that a < 0. Then it is clear from formulas (8) that x ^ 0 
and y -> 0 as t <*>, so all the paths approach (0,0) as t -»-°°. We now prove that 
the paths do not enter the point (0,0) as t —>• °°, but instead wind around it in 
a spiral-like manner. To accomplish this we introduce the polar cordinate 0 
and show that, along any path, dQ/dt is either positive for all t or negative for 
all t. We begin with the fact that 0 = tarn 1 (y/x), so 
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dQ xdy / dt - ydx / dt 


dt 


and by using equations (1) we obtain 


dO a 2 x 2 +(b 2 -a 1 )xy-b 1 y 2 
dt x 2 + y 2 


( 9 ) 


Since we are interested only in solutions that represent paths, we assume 
that x 2 + y 2 f 0. Now (7) implies that a 2 and b 1 have opposite signs. We con¬ 
sider the case in which a 2 > 0 and b 1 < 0. When y = 0, (9) yields dQ/dt -a 2 > 0. If 
y # 0, dO/dt cannot be 0; for if it were, then (9) would imply that 


a 2 x 2 +(b 2 - afxy - b t y 2 -0 


or 



( 10 ) 


for some real number x/y —and this cannot be true because the discriminant 
of the quadratic equation (10) is D, which is negative by (7). This shows that 
dQ/dt is always positive when a 2 > 0, and in the same way we see that it is 
always negative when a 2 < 0. Since by (8), x and y change sign infinitely often 
as t all paths must spiral in to the origin (counterclockwise or clockwise 
according as a 2 > 0 or a 2 < 0). The critical point in this case is therefore a spiral, 
and it is asymptotically stable. 

If a > 0, the situation is the same except that the paths approach (0,0) as 
t -* -oo and the critical point is unstable. Figure 78 illustrates the arrange¬ 
ment of the paths when a 2 > 0. 

Case D. If the roots m 1 and m 2 are real and equal, then the critical point (0,0) 
is a node. 

Proof. We begin by assuming that m : = m 2 = m < 0. There are two subcases 
that require separate discussion: (i) a r = b 2 / 0 and n 2 =b t =0; (ii) all other pos¬ 
sibilities leading to a double root of equation (3). 

We first consider the subcase (i), which is the situation described in the 
footnote in Section 56. If a denotes the common value of a x and b 2 , then equa¬ 
tion (3) becomes m 2 - 2am + a 2 ~ 0 and in-a. The system (1) is thus 


dx 


— = ax 
dt 
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and its general solution is 



( 11 ) 


where c 1 and c 2 are arbitrary constants. The paths defined by (11) are half¬ 
lines of all possible slopes (Figure 83), and since m< 0 we see that each path 
approaches and enters (0,0) as f -* The critical point is therefore a node, 
and it is asymptotically stable. If m > 0, we have the same situation except 
that the paths enter (0,0) as t -> -°°, the arrows in Figure 83 are reversed, and 
(0,0) is unstable. 

We now discuss subcase (ii). By formulas 56-(20) and Problem 56-(4), the 
general solution of (1) can be written in the form 


x=c 1 Ae mt +c 2 (A 1 +At)e mt 
y = c 1 Be mt + c 2 (B 1 +Bt)e mt , 


( 12 ) 


where the /Vs and B's are definite constants and the c's are arbitrary con¬ 
stants. When c 2 - 0, we obtain the solutions 


y 



X 


FIGURE 83 
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jx = CiAe mt 
jy = c x Be mt . 


(13) 


We know that these solutions represent two half-line paths lying on the line 
Ay = Bx with slope B/A, and since m < 0 both paths approach (0,0) as t -> °° 
(Figure 84). Also, since y/x-B/A, both paths enter (0,0) with slope B/A. If 
c 2 # 0, the solutions (12) represent curved paths, and since m < 0 it is clear 
from (12) that these paths approach (0,0) as t -> Furthermore, it follows 
from 


y Ci6e mt + c 2 (Bi + Bt)e mt c t B/c 2 + B 1 + Bt 
x CiAe mt + c 2 {Ai + At)e m ‘ CiA/c 2 + A 1 + At 


that y/x B/A as t -> °°, so these curved paths all enter (0,0) with slope B/A. 
We also observe that y/x -> B/A as f —> Figure 84 gives a qualitative pic¬ 
ture of the arrangement of these paths. It is clear that (0,0) is a node that is 
asymptotically stable. If m > 0, the situation is unchanged except that the 
directions of the paths are reversed and the critical point is unstable. 

Case E. If the roots m 1 and m 2 are pure imaginary, then the critical point (0,0) 
is a center. 



FIGURE 84 
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FIGURE 85 

Proof. It suffices here to refer back to the discussion of Case C, for now m 1 
and m 2 are of the form a ± ib with a- 0 and b / 0. The general solution of 
(1) is therefore given by (8) with the exponential factor missing, so x(t) and 
y(t) are periodic and each path is a closed curve surrounding the origin. As 
Figure 85 suggests, these curves are actually ellipses; this can be proved (see 
Problem 5) by solving the differential equation of the paths, 

dy = a 2 x + b 2 y ' (14) 

dx a r x + b x y 

Our critical point (0,0) is evidently a center that is stable but not asymptoti¬ 
cally stable. 

In the above discussions we have made a number of statements about sta¬ 
bility. It will be convenient to summarize this information as follows. 


Theorem A. The critical point (0,0) of the linear system (1) is stable if and only if 
both roots of the auxiliary equation (3) have nonpositive real parts, and it is asymp¬ 
totically stable if and only if both roots have negative real parts. 


If we now write equation (3) in the form 


(m - mf){m - mf) = m 2 + pm + q = 0 , 


( 15 ) 
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Unstable 


Asymptotically 
Stable stable 


Unstable 


P 


Saddle points 



FIGURE 86 


so that p = ~(m 1 + m 2 ) and q = m 1 m 2 , then our five cases can be described just as 
readily in terms of the coefficients p and q as in terms of the roots m 1 and m 2 . 
In fact, if we interpret these cases in the pq-plane, then we arrive at a striking 
diagram (Figure 86) that displays at a glance the nature and stability proper¬ 
ties of the critical point (0,0). The first thing to notice is that the p-axis q = 0 is 
excluded, since by condition (2) we know that m l m 2 / 0. In the light of what 
we have learned about our five cases, all of the information contained in the 
diagram follows directly from the fact that 



Thus, above the parabola p 2 - Aq = 0, we have p 2 - Aq < 0, so in , and m 2 are 
conjugate complex numbers that are pure imaginary if and only if p = 0; these 
are Cases C and E comprising the spirals and centers. Below the p-axis we 
have q < 0, which means that m, and m 2 are real, distinct, and have opposite 
signs; this yields the saddle points of Case B. And finally, the zone between 
these two regions (including the parabola but excluding the p-axis) is charac¬ 
terized by the relations p 2 - Aq > 0 and q > 0, so m 1 and m 2 are real and of the 
same sign; here we have the nodes of Cases A and D. Furthermore, it is clear 
that there is precisely one region of asymptotic stability: the first quadrant. 
We state this formally as follows. 

Theorem B. The critical point (0,0) of the linear system (1) is asymptotically stable 
if and only if the coefficients p = ~(a 1 + in) and q = a 1 b 2 - a 2 b 1 of the auxiliary equation 
(3) are both positive. 


Finally, it should be emphasized that we have studied the paths of our linear 
system near a critical point by analyzing explicit solutions of the system. 
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In the next two sections we enter more fully into the spirit of the subject by 
investigating similar problems for nonlinear systems, which in general can¬ 
not be solved explicitly. 


Problems 


1 . 


Determine the nature and stability properties of the critical point (0,0) 
for each of the following linear autonomous systems: 
dx 
dt 


(a) 


= 2x 


(b) 


dy 

dt 

dx 

dt 


3 y; 

-x-2y 


(c) 

(d) 


dy 
. dt 
dx 

It 
dy_ 
. dt 
dx 
dt 


4x-5y; 
-3x + Ay 
-2x + 3y; 
5x + 2y 


(e) 


dy 
. dt 
dx 
dt 


-17x-5y; 


-Ax-y 


(f) 


dy 

dt 

dx 

dt 

dy 

dt 


x-2 y; 
4x-3y 
8x-6y; 


2 . 



4x-2y 


— = 5x + 2y. 

[dt 

If a 1 b 2 - a 2 b l = 0, show that the system (1) has infinitely many critical 
points, none of which are isolated. 
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3. (a) If a t b 2 - a 2 b 1 / 0, show that the system 

dx 

— = flix + bpy + Ci 
, dy 

— = a 2 x + b 2 y + c 2 
. dt 

has a single isolated critical point (x 0 ,y 0 ). 

(b) Show that the system in (a) can be written in the form of (1) by 
means of the change of variables x = x - x 0 and y = y - y 0 . 

(c) Find the critical point of the system 

dX -~2x-2y + U) 
dt 

< 

— = llx-8y+ 49, 

. dt 


write the system in the form of (1) by changing the variables, and deter¬ 
mine the nature and stability properties of the critical point. 

4. In Section 20 we studied the free vibrations of a mass attached to a 
spring by solving the equation 


d 2 x 

dt 2 


+ 2 b 


dx 

dt 


+ a 2 x = 0, 


where b > 0 and a > 0 are constants representing the viscosity of the 
medium and the stiffness of the spring, respectively. Consider the 
equivalent autonomous system 



— = -a 2 x - 2 by, 
dt J 


(*) 


which has (0,0) as its only critical point. 

(a) Find the auxiliary equation of (*). What are p and q? 

(b) For each of the following four cases, describe the nature and stabil¬ 
ity properties of the critical point, and give a brief physical interpre¬ 
tation of the corresponding motion of the mass: 

(i) b = 0; 

(ii) 0 <b < a; 

(iii) b-a; 

(iv) b > a. 
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5. Solve equation (14) under the hypotheses of Case E, and show that the 
result is a one-parameter family of ellipses surrounding the origin. 
Hint: Recall that if Ax 2 + Bxy + Cy 2 -D is the equation of a real curve, 
then the curve is an ellipse if and only if the discriminant B 2 - 4 AC is 
negative. 


61 Stability By Liapunov's Direct Method 

It is intuitively clear that if the total energy of a physical system has a local 
minimum at a certain equilibrium point, then that point is stable. This idea 
was generalized by Liapunov 6 into a simple but powerful method for study¬ 
ing stability problems in a broader context. We shall discuss Liapunov's 
method and some of its applications in this and the next section. 

Consider an autonomous system 


d vr = F (x,y) 

at 

^ = G(x,y), 


( 1 ) 


and assume that this system has an isolated critical point, which as usual 
we take to be the origin (0,0)7 Let C = [x(f),y(f)] be a path of (1), and consider a 
function E(x,y) that is continuous and has continuous first partial derivatives 
in a region containing this path. If a point (x,y) moves along the path in accor¬ 
dance with the equations x = x(f) and y = y(t), then E(x,y) can be regarded as a 
function of t along C [we denote this function by E(t)] and its rate of change is 


dE dE dx dE dy 
dt dx dt dy dt 


dE _ dE 

— F + — 
dx dy 


G. 


( 2 ) 


6 Alexander Mikhailovich Liapunov (1857-1918) was a Russian mathematician and mechani¬ 
cal engineer. He had the very rare merit of producing a doctoral dissertation of lasting value. 
This classic work was originally published in 1892 in Russian, but is now available in an 
English translation. Stability of Motion, Academic Press, New York, 1966. Liapunov died by 
violence in Odessa, which cannot be considered a surprising fate for a middle-class intel¬ 
lectual in the chaotic aftermath of the Russian Revolution. 

7 A critical point (x 0 ,y 0 ) can always be moved to the origin by a simple translation of coordi¬ 
nates x =x-x 0 and y = y-y 0 , so there is no loss of generality in assuming that it lies at the 
origin in the first place. 
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This formula is at the heart of Liapunov's ideas, and in order to exploit it 
we need several definitions that specify the kinds of functions we shall be 
interested in. 

Suppose that E{x,y) is continuous and has continuous first partial deriva¬ 
tives in some region containing the origin. If E vanishes at the origin, so 
that £(0,0) = 0, then it is said to be positive definite if E(x,y) > 0 for ( x,y) / (0,0), 
and negative definite if E(x,y) < 0 for ( x,y) / (0,0). Similarly, £ is called positive 
semidefinite if E(0,0) = 0 and E(x,y) > 0 for ( x,y) / (0,0), and negative semidefinite 
if E(0,0) = 0 and E(x,y) < 0 for (x,y) / (0,0). It is clear that functions of the form 
ax 2m + by 2n , where a and b are positive constants and in and n are positive inte¬ 
gers, are positive definite. Since E(x,y) is negative definite if and only if -E(x,y) 
is positive definite, functions of the form ax 2 '" + by 2 " with a < 0 and b < 0 are 
negative definite. The functions x 2m , y 2m , and (x - if) 2 '" are not positive defi¬ 
nite, but are nevertheless positive semidefinite. If E(x,y) is positive definite, 
then z = E(x,y) can be interpreted as the equation of a surface (Figure 87) that 
resembles a paraboloid opening upward and tangent to the xy-plane at the 
origin. 

A positive definite function E(x,y) with the property that 


dE 

dx 


F + 



(3) 



FIGURE 87 
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is negative semidefinite is called a Liapunov function for the system (1). By 
formula (2), the requirement that (3) be negative semidefinite means that 
dE/dt < 0—and therefore £ is nonincreasing—along the paths of (1) near the 
origin. These functions generalize the concept of the total energy of a physi¬ 
cal system. Their relevance for stability problems is made clear in the follow¬ 
ing theorem, which is Liapunov's basic discovery. 

Theorem A. If there exists a Liapunov function E(x,y) for the system (1), then the 
critical point (0,0) is stable. Furthermore, if this function has the additional property 
that the function (3) is negative definite, then the critical point (0,0) is asymptotically 
stable. 

Proof. Let C, be a circle of radius R > 0 centered on the origin (Figure 88), and 
assume also that C, is small enough to lie entirely in the domain of definition 
of the function E. Since E(x,y) is continuous and positive definite, it has a pos¬ 
itive minimum m on C,. Next, E(x,y) is continuous at the origin and vanishes 
there, so we can find a positive number r < R such that E(x,y) < m whenever 
(x,y) is inside the circle C 2 of radius r. Now let C = [x(t), y{i)\ be any path which 
is inside C 2 for t = t 0 . Then E(t 0 ) < m, and since (3) is negative semidefinite we 
have dE/dt < 0, which implies that E(t) < E(t 0 ) < m for all t > t 0 . It follows that 
the path C can never reach the circle C, for any t > t 0 , so we have stability. 

To prove the second part of the theorem, it suffices to show that under 
the additional hypothesis we also have E(t) -> 0, for since E(x,y) is positive 
definite this will imply that the path C approaches the critical point (0,0). 



FIGURE 88 
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We begin by observing that since dE/dt < 0, it follows that E(t) is a decreasing 
function; and since by hypothesis E(t) is bounded below by 0, we conclude 
that E(t) approaches some limit L > 0 as t -* To prove that E(t) -* 0 it suf¬ 
fices to show that L = 0, so we assume that L > 0 and deduce a contradiction. 
Choose a positive number r <r with the property that E(x,y) < L whenever 
( x,y ) is inside the circle C 3 with radius r. Since the function (3) is continuous 
and negative definite, it has a negative maximum -k in the ring consisting 
of the circles Q and C 3 and the region between them. This ring contains the 
entire path C for t > t 0 , so the equation 



yields the inequality 


£(0 £ E(t 0 ) - k(t - t 0 ) 


(4) 


for all t > f 0 . However, the right side of (4) becomes negatively infinite as 
t -*■ °°, so E(t) -> as t -> This contradicts the fact that E(x,y) > 0, so we 
conclude that L = 0 and the proof is complete. 

Example 1. Consider the equation of motion of a mass m attached to a 
spring: 



dC i it 


(5) 


Here c > 0 is a constant representing the viscosity of the medium through 
which the mass moves, and k > 0 is the spring constant. The autonomous 
system equivalent to (5) is 


dx 


_ dt 



— x- y, 

m m 


( 6 ) 


and its only critical point is (0,0). The kinetic energy of the mass is my 2 /2, 
and the potential energy (or the energy stored in the spring) is 
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Thus the total energy of the system is 

E {x,y) = ^my 2 + hcx 2 - (7) 

It is easy to see that (7) is positive definite; and since 

8E 8E , ( k c \ 

— F H-G = kxy + my\ - x -y 

dx 8y v m m J 

= - cy 2 < 0 , 

(7) is a Liapunov function for (6) and the critical point (0,0) is stable. We 
know from Problem 60-4 that when c > 0 this critical point is asymptoti¬ 
cally stable, but the particular Liapunov function discussed here is not 
capable of detecting this fact. 8 


Example 2. The system 


dx 

dt 

dy_ 

dt 



( 8 ) 


has (0,0) as an isolated critical point. Let us try to prove stability by con¬ 
structing a Liapunov function of the form E(x,y)=ax 2m + by 2n . It is clear 
that 


— F +—G = 2max lm -\-2xy) + 2nby ln ~\x 2 - y 3 ) 
dx dy 

= (-4 max 2m y + 2 nbx 2 y ln ~ 1 )- 2nby ln+1 . 

We wish to make the expression in parentheses vanish, and inspection 
shows that this can be done by choosing m = l,n = l,a= 1, and b = 2. With 
these choices we have E{x,y)=x 2 +2y 2 (which is positive definite) and 
(dE/dx)F + (dE/dy)G = -4y 4 (which is negative semidefinite). The critical 
point (0,0) of the system (8) is therefore stable. 


It is clear from this example that in complicated situations it may be very dif¬ 
ficult indeed to construct suitable Liapunov functions. The following result 
is sometimes helpful in this connection. 


It is known that both stability and asymptotic stability can always be detected by suitable 
Liapunov functions, but knowing in principle that such a function exists is a very differ¬ 
ent matter from actually finding one. For references on this point, see L. Cesari, Asymptotic 
Behavior and Stability Problems in Ordinary Differential Equations, p. Ill, Academic Press, 
New York, 1963; or G. Sansone and R. Conti, Non-Linear Differential Equations, p. 481, Macmillan, 
New York, 1964. 
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Theorem B The function E(x,y) = ax 2 + bxy + cy 2 is positive definite if and only if 
a > 0 and b 2 - Aac < 0, and is negative definite if and only if a < 0 and b 2 - 4 ac < 0. 

Proof. If y = 0, we have E(x,0)-ax 2 , so E(x,0) > 0 for x / 0 if and only if a > 0. 
If y ^ 0, we have 


E(x,y) = y 2 



f 

2 

f \ 



X 

+ b 

X 


a 

— 

— 

+ c 


UJ 


1 y) 



and when a > 0 the bracketed polynomial in x/y (which is positive for large 
x/y) is positive for all x/y if and only if b 2 - 4ae < 0. This proves the first part 
of the theorem, and the second part follows at once by considering the func¬ 
tion -E(x,y). 


Problems 


1. Determine whether each of the following functions is positive definite, 
negative definite, or neither: 

(a) x 2 - xy - y 2 ; 

(b) 2x 2 - 3xi/ + 3y 2 ; 

(c) -2x 2 + 3xy - y 2 ; 

(d) -x 2 - 4xy - 5y 2 . 

2. Show that a function of the form ax 3 + bx 2 y + cxy 2 + dy 3 cannot be either 
positive definite or negative definite. 

3. Show that (0,0) is an asymptotically stable critical point for each of the 
following systems: 

dx „ 3 
= -3x - y 


(a) 


(b) 


dt 


dx 

dt 

dy 

dt 


= -2 x + xy 3 


2 2 

=-* y ■ 


4. Prove that the critical point (0,0) of the system (1) is unstable if there 
exists a function E(x,y) with the following properties: 

(a) £(x,y) is continuous and has continuous first partial derivatives in 
some region containing the origin; 
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(b) £(0,0) = 0; 

(c) every circle centered on (0,0) contains at least one point where E(x,y) 
is positive; 

(d) ( dE/dx)F + {dE/dy)G is positive definite. 

5. Show that (0,0) is an unstable critical point for the system 


dx 

It 


2xy + x 3 



+y 5 - 


6. Assume that f(x) is a function such that/(0) = 0 and xf(x) > 0 for x / 0 
[that is,/(x) > 0 when x > 0 and f(x) < 0 when x < 0]. 

(a) Show that 


E(x,y) 


|y 2 +j/(x)dx 
o 


is positive definite. 

(b) Show that the equation 


d 2 x 

dt 2 


+ /(x) = 0 


has x-0,y = dx/dt = 0 a s a stable critical point. 

(c) If g(x) > 0 in some neighborhood of the origin, show that the equation 

d 2 x dx 

^4 + g(x) — + /(x) = 0 

dt 2 ' dt J 

has x = 0,y = dx/df= 0 as a stable critical point. 


62 Simple Critical Points of Nonlinear Systems 

Consider an autonomous system 


dx 

dt 


= F(x,y) 


% = G(x,y) 
at 


(i) 
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with an isolated critical point at (0,0). If F(x,y) and G(x,y ) can be expanded in 
power series in x and y, then (1) takes the form 

dx 

— = ape + bpy + cpf + dpxy + eqy 2 + ■■■ 

' d , , <2) 

— = a 2 x + b 2 y + c 2 x 2 + d 2 xy + e 2 y 2 + ■■■. 

. dt 

When |x| and \y\ are small—that is, when {x,y) is close to the origin—the 
terms of second degree and higher are very small. It is therefore natural to 
discard these nonlinear terms and conjecture that the qualitative behavior of 
the paths of (2) near the critical point (0,0) is similar to that of the paths of the 
related linear system 


dx 

— = a\X + bry 
dt 

d ^ = a 2 x + b 2 y. 


(3) 


We shall see that in general this is actually the case. The process of replacing 
(2) by the linear system (3) is usually called linearization. 

More generally, we shall consider systems of the form 

dx 

— = a l x + b 1 y + f(x,y) 

' I « 

-by = a 2 x + b 2 y + g{x,y). 

I dt 


It will be assumed that 


so that the related linear system (3) has (0,0) as an isolated critical point; that 
f(x,y) and g(x,y) are continuous and have continuous first partial derivatives 
for all (x,y); and that as ( x,y) -* (0,0) we have 

lim !All =Q and lim =0. (6) 

Observe that conditions (6) imply that/(0,0) = 0 and y(0,0) = 0, so (0,0) is a criti¬ 
cal point of (4); also, it is not difficult to prove that this critical point is isolated 
(see Problem 1). With the restrictions listed above, (0,0) is said to be a simple 
critical point of the system (4). 
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Example 1. In the case of the system 


= -7.x + 3 y + xy 
s= -x + y - Ixy 1 


we have 


fll 

h 


-2 

3 


b 2 


-1 

1 


(7) 


so (5) is satisfied. Furthermore, by using polar coordinates we see that 


\f(x,y)\ |r 2 sin0 cos 9| 

V* +f ~ r 


and 


\g( x >y)\ 

^7 


|2r 3 sin 2 Ocos0| 

1 - L < 2 r 2 , 

r 


so f(x,y)/r and g(x,y)/r -*• 0 as (x,y) -> (0,0) (or as r -> 0). This shows that 
conditions (6) are also satisfied, so (0,0) is a simple critical point of the 
system (7). 


The main facts about the nature of simple critical points are given in the fol¬ 
lowing theorem of Poincare, which we state without proof. 9 


Theorem A. Let (0,0) be a simple critical point of the nonlinear system (4), and 
consider the related linear system (3). If the critical point (0,0) of (3) falls under any 
one of the three major cases described in Section 60, then the critical point (0,0) of (4) 
is of the same type. 


9 Detailed treatments can be found in W. Hurewicz, Lectures on Ordinary Differential Equations, 
pp. 86-98, MIT, Cambridge, Mass., 1958; L. Cesari, Asymptotic Behavior and Stability Problems in 
Ordinary Differential Equations, pp. 157-163, Academic Press, New York, 1963; or F. G. Tricomi, 
Differential Equations, pp. 53-72, Blackie, Glasgow, 1961. 














550 


Differential Equations with Applications and Historical Notes 


As an illustration, we examine the nonlinear system (7) of Example 1, whose 
related linear system is 


dx 
dt 
dy_ 
„ dt 


-2x + 3 y 


-x + ij. 


( 8 ) 


The auxiliary equation of (8) is m 2 +m+ 1 = 0, with roots 

—1 + V3 i 
nh,m 2 = ---. 

Since these roots are conjugate complex but not pure imaginary, we have 
Case C and the critical point (0,0) of the linear system (8) is a spiral. By 
Theorem A, the critical point (0,0) of the nonlinear system (7) is also a spiral. 

It should be understood that while the type of the critical point (0,0) is the 
same for (4) as it is for (3) in the cases covered by the theorem, the actual 
appearance of the paths may be somewhat different. For example. Figure 82 
shows a typical saddle point for a linear system, whereas Figure 89 suggests 
how a nonlinear saddle point might look. A certain amount of distortion is 
clearly present in the latter, but nevertheless the qualitative features of the 
two configurations are the same. 

It is natural to wonder about the two borderline cases, which are not men¬ 
tioned in Theorem A. The facts are these: if the related linear system (3) has a 
borderline node at the origin (Case D), then the nonlinear system (4) can have 



FIGURE 89 
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either a node or a spiral; and if (3) has a center at the origin (Case E), then (4) 
can have either a center or a spiral. For example, (0,0) is a critical point for 
each of the nonlinear systems 


dx 
dt 
dy 
. dt 


= -y-x 


= X 


and 


dx o 

— = -y-x 
dt J 



In each case the related 


linear system is 


dx 

dt 


= -y 


dy 

— = x. 
dt 


(9) 


( 10 ) 


It is easy to see that (0,0) is a center for (10). However, it can be shown that 
while (0,0) is a center for the first system of (9), it is a spiral for the second. 10 

We have already encountered a considerable variety of configurations at 
critical points of linear systems, and the above remarks show that no new 
phenomena appear at simple critical points of nonlinear systems. What about 
critical points that are not simple? The possibilities here can best be appreci¬ 
ated by examining a nonlinear system of the form (2). If the linear terms in 
(2) do not determine the pattern of the paths near the origin, then we must 
consider the second degree terms; if these fail to determine the pattern, then 
the third degree terms must be taken into account, and so on. This suggests 
that in addition to the linear configurations, a great many others can arise, of 
infinite variety and staggering complexity. Several are shown in Figure 90. 
It is perhaps surprising to realize that such involved patterns as these can 
occur in connection with systems of rather simple appearance. For example, 
the three figures in the upper row show the arrangement of the paths of 


dx 

17 = 2xy 
at 

dx , _ , 

— = x 3 - 2xxr 

dt 

"Vs 

1 

II 



- = x 


-4yJ\xy\ 


dx 
dt 

dy , „ 
— = -y + 4xJ\xy 
dt J Vl J 


In the first case, this can be seen at once by looking at Figure 3 and 
equation 3-(8). 

We now discuss the question of stability for a simple critical point. The 
main result here is due to Liapunov: if (3) is asymptotically stable at the ori¬ 
gin, then (4) is also. We state this formally as follows. 


10 See Hurewicz, op. cit., p. 99. 
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FIGURE 90 


Theorem B. Let (0,0) be a simple critical point of the nonlinear system (4), and 
consider the related linear system (3). If the critical point (0,0) of (3) is asymptotically 
stable, then the critical point (0,0) o/(4) is also asymptotically stable. 

Proof. By Theorem 61-A, it suffices to construct a suitable Liapunov function 
for the system (4), and this is what we do. 

Theorem 60-B tells us that the coefficients of the linear system (3) satisfy 
the conditions 


p = -(flj + b 2 )> 0 and q = a r b 2 - a 2 b 1 > 0. 


( 11 ) 


Now define 


by putting 


and 


E(x, y) = — (ax 2 + 2bxy + cy 2 ) 


a = 


a 2 + b 2 + (af} 2 — a 2 bf) 
D ' 


a]a 2 + b 2 b 2 
D 


a 2 + b 2 +(af> 2 -a 2 b 2 ) 


D 
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where 


D=pq = -(a x + b 2 )(a 1 b 2 - a 2 b i). 

By (11), we see that D > 0 and a > 0. Also, an easy calculation shows that 

D 2 (ac-b 2 ) = (a 2 + b 2 )(a\ + b 2 ) 

+ (ai + bi + a 2 + b 2 )(a 1 b 2 - a 2 b 
+ (a 1 b 2 - a 2 b\) 2 - (a x a 2 + b x b 2 ) 2 


= («2 + bl + al + b^)(a x b 2 - a 2 b x ) 

+ l(a x b 2 — a 2 b x y 

> 0 , 

so b 2 - ac < 0. Thus, by Theorem 61-B, we know that the function E(x,ij) is 
positive definite. Furthermore, another calculation (whose details we leave 
to the reader) yields 

f^(«i* + h y) + + b 2 y) = -(x 2 + y 2 ). (12) 

ox oy 

This function is clearly negative definite, so E(x,y) is a Liapunov function for 
the linear system (3)! 1 

We next prove that E(x,y) is also a Liapunov function for the nonlinear 
system (4). If F and G are defined by 

F(x,y) = a : x + b : y+f(x,y) 


and 


G{x,y) = a 2 x + b 2 y+g(x,y), 

then since E is known to be positive definite, it suffices to show that 


dE 

dx 


F + 



(13) 


11 The reason for the definitions of a, b, and c can now be understood: we want (12) to be true. 
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is negative definite. If we use (12), then (13) becomes 

-(x 2 + y 2 ) + (ax + hy)f(x,y) + (bx + cy)g(x,y); 

and by introducing polar coordinates we can write this as 

-r 2 + r[(a cos 0 + b sin 0)/(x,y) + (b cos 0 + c sin Q)g(x,y)\ 

Denote the largest of the numbers \a\, \b\, |c| by K. Our assumption (6) now 
implies that 




and 


ls(*/y)l< 


r 

6 K 


for all sufficiently small r > 0, so 


8E r dE„ 2 410 

— F + — G<-r + - 

dx dy 6K 



for these r's. Thus E(x,y) is a positive definite function with the property that 
(13) is negative definite. Theorem 61-A now implies that (0,0) is an asymptoti¬ 
cally stable critical point of (4), and the proof is complete. 


To illustrate this theorem, we again consider the nonlinear system (7) of 
Example 1, whose related linear system is (8). For (8) we have p = 1 > 0 and 
q = 1 > 0, so the critical point (0,0) is asymptotically stable, both for the linear 
system (8) and for the nonlinear system (7). 


Example 2. We know from Section 58 that the equation of motion for the 
damped vibrations of a pendulum is 


d 2 x c dx 

0 H---h 

dt 2 m dt 


O’ 

—sinx = 0, 
a 


where c is a positive constant. The equivalent nonlinear system is 

dx 

— = y 

dt (14) 


dy g . c 

— = --smi- y. 

^dt a m 
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Let us now write (14) in the form 


dx 

dt 


= y 


dy S c S / . \ 

—— — ——x - y + — (x-smx). 

dt a m a 


(15) 


It is easy to see that 


x - sin x 

i — —>0 

V* 2 + y 2 


as (x,y) (0,0), for if x ^ 0, we have 


|x-sinx| |x-sinx| 

V + y 2 " M 

and since (0,0) is evidently an isolated critical point of the related linear 
system 


l-^UO; 

x 


dx 

, dt (16) 

dy g c 

— = -—x - y, 

. dt a m 

it follows that (0,0) is a simple critical point of (15). Inspection shows 
(p=c/m > 0 and q=g/a > 0) that (0,0) is an asymptotically stable critical 
point of (16), so by Theorem B it is also an asymptotically stable critical 
point of (15). This reflects the obvious physical fact that if the pendulum 
is slightly disturbed, then the resulting motion will die out with the pas¬ 
sage of time. 


Problems 

1. Prove that if (0,0) is a simple critical point of (4), then it is necessar¬ 
ily isolated. Hint: Write conditions (6) in the form f(x,\j)/r = e x -> 0 and 
g(x,y)/r -e 2 ^ 0, and in the light of (5) use polar coordinates to deduce a 
contradiction from the assumption that the right sides of (4) both vanish 
at points arbitrarily close to the origin but different from it. 
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2. Sketch the family of curves whose polar equation is r=a sin 20 (see 
Figure 90), and express the differential equation of this family in the 
form dy/dx = G(x,y)/E(x,y). 

3. If (0,0) is a simple critical point of (4) and q=a 1 b 2 - a 2 b } < 0, then 
Theorem A implies that (0,0) is a saddle point of (4) and is therefore 
unstable. Prove that if p = -(a 1 + fr 2 ) < 0 and q = a 1 b 2 - a 2 b l > 0, then (0,0) is 
an unstable critical point of (4). Hint: Adapt the proof of Theorem B to 
show that there exists a positive definite function E(x,y) such that 

—(fl 1 x + Diy) +— (a 2 x + b 2 y) = x +y , 
dx dy 


and apply Problem 61-4. (Observe that these facts together with Theorem 
B demonstrate that all the information in Figure 86 about asymptotic 
stability and instability carries over directly to nonlinear systems with 
simple critical points from their related linear systems.) 

4. Show that (0,0) is an asymptotically stable critical point of 


dx 

It 

dy_ 
. dt 


= -y-x 


3 


~ x-y 3 , 


but is an unstable critical point of 


dx 
dt 
dy 
_ dt 


= -y + x 3 
= x + y 3 . 


Flow are these facts related to the parenthetical remark in Problem 3? 

5. Verify that (0,0) is a simple critical point for each of the following sys¬ 
tems, and determine its nature and stability properties: 

, . dx „ 

(a) — = x + y - 2 xy 

dt 

= -2x + y + 3y 2 ; 


(b) 


dx 

dt 

dt 


- = -x- 


y-3x y 
= -2x-4y + i/sinx. 
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6. The van der Pol equation 

d 2 x , 2 . s dx n 
+ -1) — 7 + x = 0 

Clt Clt 

is equivalent to the system 

dx 



^ = -x-q(x 2 -l )y. 

„ dr 

Investigate the stability properties of the critical point (0,0) for the cases 
q > 0 and p < 0. 


63 Nonlinear Mechanics. Conservative Systems 

It is well known that energy is dissipated in the action of any real dynamical 
system, usually through some form of friction. However, in certain situa¬ 
tions this dissipation is so slow that it can be neglected over relatively short 
periods of time. In such cases we assume the law of conservation of energy, 
namely, that the sum of the kinetic energy and the potential energy is con¬ 
stant. A system of this kind is said to be conservative. Thus the rotating earth 
can be considered a conservative system over short intervals of time involv¬ 
ing only a few centuries, but if we want to study its behavior throughout 
millions of years we must take into account the dissipation of energy by tidal 
friction. 

The simplest conservative system consists of a mass m attached to a spring 
and moving in a straight line through a vacuum. If x denotes the displace¬ 
ment of m from its equilibrium position, and the restoring force exerted on m 
by the spring is -kx where k> 0, then we know that the equation of motion is 


dt 2 

A spring of this kind is called a linear spring because the restoring force is a 
linear function of x. If m moves through a resisting medium, and the resis¬ 
tance (or damping force) exerted on m is -c(dx/dt) where c > 0, then the equa¬ 
tion of motion of this nonconservative system is 
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Here we have linear damping because the damping force is a linear function 
of dx/dt. By analogy, if/and g are arbitrary functions with the property that 
/(0) = 0 and y(0) = 0, then the more general equation 

d 2 x (dx'] „ 


can be interpreted as the equation of motion of a mass m under the action of 
a restoring force -f(x) and a damping force -g(dx/dt). In general these forces are 
nonlinear, and equation (1) can be regarded as the basic equation of nonlin¬ 
ear mechanics. In this section we shall briefly consider the special case of a 
nonlinear conservative system described by the equation 

+ /(*) = 0, (2) 


in which the damping force is zero and there is consequently no dissipation 
of energy. 12 

Equation (2) is equivalent to the autonomous system 


dx 



dy = fix) 
. dt m 


(3) 


If we eliminate dt, we obtain the differential equation of the paths of (3) in 
the phase plane. 


dy /(*) 

dx my 

and this can be written in the form 

my dy = -f(x) dx. 

If x = x 0 and y = y 0 when t = t 0 , then integrating (5) from t 0 to t yields 


X 



*0 


(4) 

(5) 


12 Extensive discussions of (1), with applications to a variety of physical problems, can be 
found in J. J. Stoker, Nonlinear Vibrations, Interscience-Wiley, New York, 1950; and in A. A. 
Andronow and C. E. Chaikin, Theory of Oscillations, Princeton University Press, Princeton, 
N.J., 1949. 
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or 


1 2 

—my + 


^f{x)dx = ^myl + 


*0 

J* f(x)dx. 


( 6 ) 


To interpret this result, we observe that 
energy of the dynamical system and 


1 1 

— my 2 = —m(dx/dt) 2 is the kinetic 


X 

V(x) = jf(x)dx (7) 

o 

is its potential energy Equation (6) therefore expresses the law of conserva¬ 
tion of energy. 


| my 2 + V(x) = E , (8) 

where £ = \my\ + V(x 0 ) is the constant total energy of the system. It is clear 
that (8) is the equation of the paths of (3), since we obtained it by solving (4). 
The particular path determined by specifying a value of £ is a curve of con¬ 
stant energy in the phase plane. The critical points of the system (3) are the 
points (x c ,0) where the x c are the roots of the equation/(x) = 0. As we pointed 
out in Section 58, these are the equilibrium points of the dynamical system 
described by (2). It is evident from (4) that the paths cross the x-axis at right 
angles and are horizontal when they cross the lines x=x c . Equation (8) also 
shows that the paths are symmetric with respect to the x-axis. 

If we write (8) in the form 


y = ±. 


-[E-V(x)] t 

m 


(9) 


then the paths can be constructed by the following easy steps. First, estab¬ 
lish an xz-plane with the z-axis on the same vertical line as the y-axis of the 
phase plane (Figure 91). Next, draw the graph of z = V(x) and several hori¬ 
zontal lines z = £ in the xz-plane (one such line is shown in the figure), and 
observe the geometric meaning of the difference £ - V(x). Finally, for each x, 
multiply £ - V(x) as obtained in the preceding step by 1/m and use formula 
(9) to plot the corresponding values of y in the phase plane directly below. 
Note that since dx/dt-y, the positive direction along any path is to the right 
above the x-axis and to the left below this axis. 
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FIGURE 91 


Example 1. We saw in Section 58 that the equation of motion of an 
undamped pendulum is 


d 2 x 
dt 1 


+ Asinx = 0, 


( 10 ) 


where A: is a positive constant. Since this equation is of the form (2), it can 
be interpreted as describing the undamped rectilinear motion of a unit 
mass under the influence of a nonlinear spring whose restoring force is 
-k sin x. The autonomous system equivalent to (10) is 
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— = -ksinx, 
_ dt 


( 11 ) 


and its critical points are (0,0), (±Jt,0), (±2jt,0), .... The differential equa¬ 
tion of the paths is 


dy _ k sinx 
dx y 

and by separating variables and integrating, we see that the equation of 
the family of paths is 


1 

— y 2 +(k-kcosx) = E. 

This is evidently of the form (8), where m = 1 and 

X 

V{x) = J/(x)dx = k -kcosx 
o 

is the potential energy. We now construct the paths by first drawing 
the graph of z = V(x) and several lines z = E in the xz-plane (Figure 92, 
where z = E = 2k is the only line shown). From this we read off the' val¬ 
ues E - V(x) and sketch the paths in the phase plane directly below by 
using y = ±yj2[E-V(x)]. It is clear from this phase portrait that if the 
total energy E is between 0 and 2k, then the corresponding paths are 
closed and equation (10) has periodic solutions. On the other hand, if 
E > 2k, then the path is not closed and the corresponding solution of 
(10) is not periodic. The value E = 2k separates the two types of motion, 
and for this reason a path corresponding to E = 2k is called a separa- 
trix. The wavy paths outside the separatrices correspond to whirling 
motions of the pendulum, and the closed paths inside to oscillatory 
motions. It is evident that the critical points are alternately unstable 
saddle points and stable but not asymptotically stable centers. For the 
sake of contrast, it is interesting to consider the effect of transforming 
this conservative dynamical system into a nonconservative system by 
introducing a linear damping force. The equation of motion then takes 
the form 


d 2 x dx , . 

—z- + c-hfcsinx = 0, c>0, 

dt 2 dt 

and the configuration of the paths is suggested in Figure 93. We find that 
the centers in Figure 92 become asymptotically stable spirals, and also 
that every path—except the separatrices entering the saddle points as 
t -> °° ultimately winds into one of these spirals. 
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FIGURE 92 



FIGURE 93 
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Problems 


1. If/(0) = 0 and x/(x) > 0 for x # 0, show that the paths of 


d 2 x 
dt 2 


+ /(x) = 0 


are closed curves surrounding the origin in the phase plane; that is, 
show that the critical point x = 0, y = dx/dt = 0 is a stable but not asymp¬ 
totically stable center. Describe this critical point with respect to its 
nature and stability if/(0) = 0 and x/(x) < 0 for x / 0. 

2. Most actual springs are not linear. A nonlinear spring is called hard or soft 
according as the magnitude of the restoring force increases more rapidly 
or less rapidly than a linear function of the displacement. The equation 


d 2 x 

dt 2 


+ kx + ax 3 = 0, 


k > 0, 


describes the motion of a hard spring if a > 0 and a soft spring if a < 0. 
Sketch the paths in each case. 

3. Find the equation of the paths of 

d 2 x _ o „ 

—p- - x + 2x = 0, 

and sketch these paths in the phase plane. Locate the critical points and 
determine the nature of each. 

4. Since by equation (7) we have dV/dx -fix), the critical points of (3) are 
the points on the x-axis in the phase plane at which V'(x)=0. In terms 
of the curve z = V(x )—if this curve is smooth and well behaved—there 
are three possibilities: maxima, minima, and points of inflection. Sketch 
all three possibilities, and determine the type of critical point associated 
with each (a critical point of the third type is called a cusp). 


64 Periodic Solutions. The Poincare-Bendixson Theorem 

Consider a nonlinear autonomous system 


dx 

dt 


= F(x,y) 




( 1 ) 
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in which the functions F(x,y) and G(x,y ) are continuous and have continuous 
first partial derivatives throughout the phase plane. Our work so far has told 
us practically nothing about the paths of (1) except in the neighborhood of 
certain types of critical points. However, in many problems we are much 
more interested in the global properties of paths than we are in these local 
properties. Global properties of paths are those that describe their behavior 
over large regions of the phase plane, and in general they are very difficult 
to establish. 

The central problem of the global theory is that of determining whether 
(1) has closed paths. As we remarked in Section 58, this problem is 
important because of its close connection with the issue of whether (1) has 
periodic solutions. A solution x(t) and y(t) of (1) is said to be periodic if nei¬ 
ther function is constant, if both are defined for all f, and if there exists a 
number T > 0 such that x(t + T) = x(t) and y(t + T) = y(t) for all t. The smallest 
T with this property is called the period of the solution. 13 It is evident that 
each periodic solution of (1) defines a closed path that is traversed once 
as f increases from t 0 to t 0 +T for any t 0 . Conversely, it is easy to see that 
if C = [x{t),y{t)\ is a closed path of (1), then x(t), y(t) is a periodic solution. 
Accordingly, the search for periodic solutions of (1) reduces to a search for 
closed paths. 

We know from Section 60 that a linear system has closed paths if and 
only if the roots of the auxiliary equation are pure imaginary, and in this 
case every path is closed. Thus, for a linear system, either every path is 
closed or else no path is closed. On the other hand, a nonlinear system can 
perfectly well have a closed path that is isolated, in the sense that no other 
closed paths are near to it. The following is a well-known example of such 
a system: 


^ = -y + X (l-x 2 -y 2 ) 

~77 = x+ y(i -x 2 - y 2 )- 

l at 


( 2 ) 


To solve this system we introduce polar coordinates r and 0, where 
x-r cos 0 and y-r sin 0. If we differentiate the relations x 2 + y 2 - r 2 and 0 = tan* 1 
(y/x), we obtain the useful formulas 



(3) 


13 Every periodic solution has a period in this sense. Why? 
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On multiplying the first equation of (2) by x and the second by y, and adding, 
we find that 


r^ = r 2 (l-r 2 ). (4) 

at 

Similarly, if we multiply the second by x and the first by y, and subtract, we 
get 


2 dQ 
r — 
dt 


= r 


( 5 ) 


The system (2) has a single critical point at r = 0. Since we are concerned only 
with finding the paths, we may assume that r > 0. In this case, (4) and (5) 
show that (2) becomes 


dr 

It 
dQ 
. dt 


= r(l-r 2 ) 

= 1 . 


( 6 ) 


These equations are easy to solve separately, and the general solution of the 
system (6) is found to be 


< r 

e = f+f 0 . 

The corresponding general solution of (2) is 

r _ cos (t + tp) 
\ll + ce~ 2t 

< 

_ sin(f + t 0 ) 
\ll + ce~ 2t 


( 7 ) 


( 8 ) 


Let us analyze (7) geometrically (Figure 94). If c- 0, we have the solutions 
r = l and Q = t + t 0 , which trace out the closed circular path x 2 + y 2 =l in the 
counterclockwise direction. If c < 0, it is clear that r > 1 and that r 1 as 
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FIGURE 94 


t Also, if c > 0, we see that r < 1, and again r -* 1 as f These observa¬ 
tions show that there exists a single closed path (r= 1) which all other paths 
approach spirally from the outside or the inside as t -> 

In the above discussion we have shown that the system (2) has a closed 
path by actually finding such a path. In general, of course, we cannot hope 
to be able to do this. What we need are tests that make it possible for us to 
conclude that certain regions of the phase plane do or do not contain closed 
paths. Our first test is given in the following theorem of Poincare. A proof is 
sketched in Problem 1. 


Theorem A. A closed path of the system (1) necessarily surrounds at least one criti¬ 
cal point of this system. 


This result gives a negative criterion of rather limited value: a system with¬ 
out critical points in a given region cannot have closed paths in that region. 

Our next theorem provides another negative criterion, and is due to 
Bendixson. 14 


14 Ivar Otto Bendixson (1861-1935) was a Swedish mathematician who published one impor¬ 
tant memoir in 1901 supplementing some of Poincare's earlier work. He served as professor 
(and later as president) at the University of Stockholm, and was an energetic long-time mem¬ 
ber of the Stockholm City Council. 
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Theorem B. If dE/dx + dG/dy is always positive or always negative in a certain 
region of the phase plane, then the system (1) cannot have closed paths in that 
region. 

Proof. Assume that the region contains a closed path C = [x{t),y{t)\ with inte¬ 
rior R. Then Green's theorem and our hypothesis yield 




5G" 

3 /, 


dxdy * 0. 


However, along C we have dx=F dt and dy = G dt, so 

T 

J(Fdy-Gdx) = J(FG-GF)df = 0. 

c o 


This contradiction shows that our initial assumption is false, so the region 
under consideration cannot contain any closed path. 


These theorems are sometimes useful, but what we really want are posi¬ 
tive criteria giving sufficient conditions for the existence of closed paths of 
(1). One of the few general theorems of this kind is the classical Poincare- 
Bendixson theorem, which we now state without proof. 15 


Theorem C. Let Rbe a bounded region of the phase plane together with its bound¬ 
ary, and assume that R does not contain any critical points of the system (1). 
If C- [x(f),y(f)] is a path of { 1) that lies in Rfor some t 0 and remains in Rfor all t > t 0 , 
then C is either itself a closed path or it spirals toward a closed path as t °°. Thus 
in either case the system (1) has a closed path in R. 


In order to understand this statement, let us consider the situation suggested 
in Figure 95. Here R consists of the two dashed curves together with the ring- 
shaped region between them. Suppose that the vector 

V(x,y)=F(x,y)i + G(x,y)) 

points into R at every boundary point. Then every path C through a bound¬ 
ary point (at t = t 0 ) must enter R and can never leave it, and under these cir¬ 
cumstances the theorem asserts that C must spiral toward a closed path C 0 . 


15 For details, see Hurewicz, loc. cit., pp. 102-111, or Cesari, loc. cit., pp. 163-167. 
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FIGURE 95 


We have chosen a ring-shaped region R to illustrate the theorem because a 
closed path like C 0 must surround a critical point (P in the figure) and R must 
exclude all critical points. 

The system (2) provides a simple application of these ideas. It is clear that 
(2) has a critical point at (0,0), and also that the region R between the circles 
r = l/2 and r = 2 contains no critical points. In our earlier analysis we found 
that 


— = r(l-r 2 ) forr>0. 


dt 


This shows that dr/dt > 0 on the inner circle and dr/dt < 0 on the outer circle, 
so the vector V points into R at all boundary points. Thus any path through 
a boundary point will enter R and remain in R as t -* °°, and by the Poincare- 
Bendixson theorem we know that R contains a closed path C 0 . We have 
already seen that the circle r = 1 is the closed path whose existence is guar¬ 
anteed in this way. 

The Poincare-Bendixson theorem is quite satisfying from a theoretical 
point of view, but in general it is rather difficult to apply. A more practical 
criterion has been developed that assures the existence of closed paths for 
equations of the form 



(9) 
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which is called Lienard's equation. 16 When we speak of a closed path for such 
an equation, we of course mean a closed path of the equivalent system 


dx 

dt 


= y 




( 10 ) 


and as we know, a closed path of (10) corresponds to a periodic solution of 
(9). The fundamental statement about the closed paths of (9) is the following 
theorem. 


Theorem D. (Lienard's Theorem.) Let the functions f(x) and g(x) satisfy the fol¬ 
lowing conditions: (i) both are continuous and have continuous derivatives for all x; 
(ii) g(x) is an odd function such that g(x) > 0 for x > 0, andf(x) is an even function; 
and (iii) the odd function F(x) = Jo f(x)dx has exactly one positive zero at x = a, is 
negative for 0 <x<a,is positive and nondecreasing for x > a, and F(x) -»• °° as x -»• 
Then equation (9) has a unique closed path surrounding the origin in the phase plane, 
and this path is approached spirally by every other path as t -> 


For the benefit of the skeptical and tenacious reader who is rightly reluc¬ 
tant to accept unsupported assertions, a proof of this theorem is given in 
Appendix B. An intuitive understanding of the role of the hypotheses can 
be gained by thinking of (9) in terms of the ideas of the previous section. 
From this point of view, equation (9) is the equation of motion of a unit mass 
attached to a spring and subject to the dual influence of a restoring force 
-g(x) and a damping force -f(x) dx/dt. The assumption about g(x) amounts 
to saying that the spring acts as we would expect, and tends to diminish 
the magnitude of any displacement. On the other hand, the assumptions 
about/(x)—roughly, that f(x) is negative for small |x| and positive for large 
|x|—mean that the motion is intensified for small |x| and retarded for 
large \x\, and therefore tends to settle down into a steady oscillation. This 
rather peculiar behavior of f(x) can also be expressed by saying that the 
physical system absorbs energy when |x| is small and dissipates it when 
| x | is large. 


16 Alfred Lienard (1869-1958) was a French scientist who spent most of his career teaching 
applied physics at the School of Mines in Paris, of which he became director in 1929. His 
physical research was mainly in the areas of electricity and magnetism, elasticity, and 
hydrodynamics. From time to time he worked on mathematical problems arising from his 
other scientific investigations, and in 1933 was elected president of the French Mathematical 
Society. He was an unassuming bachelor whose life was devoted entirely to his work and his 
students. 
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The main application of Lienard's theorem is to the van der Pol 17 equation 

rl^Y ply 

^4 + p(x 2 -l) —+ x = 0, (11) 

dt 2 at 

where (i is assumed to be a positive constant for physical reasons. Here 
f(x) = |r(x 2 - 1) and g(x)-x, so condition (i) is clearly satisfied. It is equally clear 
that condition (ii) is true. Since 


F(x) = pj^x 3 - *j = ^px(x 2 -3), 

we see that F(x) has a single positive zero at x = -J3, is negative for 0 < x < V3, 
is positive for x > V3, and that F(x) -> °° as x -*■ °°. Finally, F'(x) = p(x 2 - 1) is posi¬ 
tive for x > 1, so F(x) is certainly nondecreasing (in fact, increasing) for x > -J3. 
Accordingly, all the conditions of the theorem are met, and we conclude that 
equation (11) has a unique closed path (periodic solution) that is approached 
spirally (asymptotically) by every other path (nontrivial solution). 


Problems 

1. A proof of Theorem A can be built on the following geometric ideas 
(Figure 96). Let C be a simple closed curve (not necessarily a path) in 
the phase plane, and assume that C does not pass through any critical 
point of the system (1). If P = (x,y) is a point on C, then 

V(x,y)=F(x,y)i + G(x,y)j 

is a nonzero vector, and therefore has a definite direction given by the 
angle 0. If P moves once around C in the counterclockwise direction, 
the angle 0 changes by an amount A0 = 2nn, where n is a positive integer, 
zero, or a negative integer. This integer n is called the index of C. If C 
shrinks continuously to a smaller simple closed curve C 0 without pass¬ 
ing over any critical point, then its index varies continuously; and since 
the index is an integer, it cannot change. 


17 Balthasar van der Pol (1889-1959), a Dutch scientist specializing in the theoretical aspects of 
radioengineering, initiated the study of equation (11) in the 1920s, and thereby stimulated 
Lienard and others to investigate the mathematical theory of self-sustained oscillations in 
nonlinear mechanics. 
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X 


FIGURE 96 


(a) If C is a path of (1), show that its index is 1. 

(b) If C is a path of (1) that contains no critical points, show that a small 
C 0 has index 0, and from this infer Theorem A. 

2. Consider the nonlinear autonomous system 

— = 4x + 4y-x(x * 2 3 + y 2 ) 

< 

^ = -4x + 4 y-y(x 2 + y 2 ). 

[dr 


(a) Transform the system into polar coordinate form. 

(b) Apply the Poincare-Bendixson theorem to show that there is a 
closed path between the circles r = 1 and r- 3. 

(c) Find the general nonconstant solution x = x(t) and y = y(t) of the orig¬ 
inal system, and use this to find a periodic solution corresponding 
to the closed path whose existence was established in (b). 

(d) Sketch the closed path and at least two other paths in the phase 
plane. 

3. Show that the nonlinear autonomous system 


dx 

dt 

dy 

At 


= 3x-j j -xe x2+yl 
= x + 3y-ye x2+ ' j2 


has a periodic solution. 
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4. In each of the following cases use a theorem of this section to determine 
whether or not the given differential equation has a periodic solution: 


(a) 

(b) 

(c) 

(d) 

(e) 


dx ,_ 4 Ax 


dt 

d 2 x 


2 + (5x -9x ) —+ x =0; 


dt 


(x 2 + 1) — + x 5 = 0; 
dt 2 v ' dt 


d 2 x 

dt 2 


-(1 + x 2 ) = 0; 


d 2 x dx f dx . „ , _ 

+ — + — -3x* =0; 


dt 2 dt {dt, 
d 2 x h dx n dx 


dt 2 


dx 

dt 


dt 


5. Show that any differential equation of the form 


d 2 x 


. dx 
dt 


a — 2 - + fr(x -1)— + cx = 0 (a, b, c > 0) 


can be transformed into the van der Pol equation by a change of the 
independent variable. 


65 More about the van der Pol Equation 

First, a bit history. In World War II, in the fall of 1940, Hitler's German Army 
had swept across France and was poised on the coast of the English Channel, 
ready to invade England and complete its conquest of Western Europe. To do 
this they needed control of the air, and their Air Force was ready to attack 
and destroy London and Southeast England. All that stood in their way was 
the British Royal Air Force (R.A.F) and its small number of young fighter 
pilots. But with the help of the newly invented radar to tell them in advance 
where and when the German bombers were coming, the R.A.F. pilots suc¬ 
cessfully fought off the Germans and defeated Hitler's plans for conquest. 
This so-called Battle of Britain was a major turning point of the war, of which 
Winston Churchill said, "Never in the history of human conflict was so much 
owed by so many to so few." 

The detailed connection between radar and the van der Pol equation dis¬ 
cussed in Section 64 can only be understood by a skilled electrical engineer, 
which the present writer is not. However, it turned out that solutions of the 
equation were closely related to increasing difficulties in getting reliable 
radar information back from greater and greater distances. 
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The eminent theoretical physicist/mathematician Freeman Dyson was 
in England at the time, and has some interesting memories of these events. 
Dyson came to America in 1947 and has been a permanent Professor at The 
Institute for Advanced Study in Princeton, New Jersey since 1953. Professor 
Dyson's recollections (1996) are as follows: 

In 1942 when I was a student in Cambridge, I heard a lecture by Mary 
Cartwright about the van der Pol equation. Cartwright had been work¬ 
ing with Littlewood on the solutions of the equation, which describe the 
output of a nonlinear radio amplifier when the input is a pure sine wave. 
The whole development of radar in World War II depended on high-power 
amplifiers, and it was a matter of life and death to have amplifiers that did 
what they were supposed to do. The soldiers were plagued with amplifiers 
that misbehaved and blamed the manufacturers for their erratic behav¬ 
ior. Cartwright and Littlewood discovered that the manufacturers were 
not to blame. The equation itself was to blame. They discovered that as 
you raise the gain of the amplifier, the solutions of the equation become 
more and more irregular. At low power the solution has the same period 
as the input, but as the power increases you see solutions with double the 
period, then with quadruple the period, and finally you have solutions 
that are not periodic at all. Cartwright and Littlewood explored the behav¬ 
ior of solutions in detail and discovered the phenomena that later became 
known as "chaos." They published all this in a paper in the Journal of the 
London Mathematical Society, which appeared in 1945. That was a bad year 
to publish. Paper in England was scarce and few copies of the Journal 
were printed. Mathematicians everywhere were still busy fighting the 
war. The paper attracted no attention. In 1949 Mary Cartwright came to 
Princeton and talked about the work again. Again she attracted no atten¬ 
tion. Littlewood was not helpful. In the foreword to Littlewood's collected 
papers is a description written by Littlewood about his collaboration with 
Cartwright: 

"Two rats fell into a can of milk. After swimming for a time one of them 
realized his hopeless fate and drowned. The other persisted, and at last 
the milk turned to butter and he could get out." 

Littlewood does not say whether the rat who drowned was himself or 
Cartwright. In either case the passage makes clear that Littlewood did not 
understand the importance of the work that he and Cartwright had done. 
Only Cartwright understood it, and she is not a person who likes to blow her 
own trumpet. She put the van der Pol equation to one side and went on to a 
distinguished career in analytic function theory and university administra¬ 
tion. She became President of the London Mathematical Society in 1961, and 
Dame Mary (the female equivalent of a knighthood) in 1969. By that time, 
the phenomena of chaos had been rediscovered. A few years later, they were 
given their modern names. 
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Appendix A. Poincare 

Jules Henri Poincare (1854-1912) was universally recognized at the begin¬ 
ning of the twentieth century as the greatest mathematician of his genera¬ 
tion. He began his academic career at Caen in 1879, but only two years later 
he was appointed to a professorship at the Sorbonne. He remained there 
for the rest of his life, lecturing on a different subject each year. In his lec¬ 
tures—which were edited and published by his students—he treated with 
great originality and mastery of technique virtually all known fields of 
pure and applied mathematics, and many that were not known until he 
discovered them. Altogether he produced more than 30 technical books on 
mathematical physics and celestial mechanics, half a dozen books of a more 
popular nature, and almost 500 research papers on mathematics. He was a 
quick, powerful, and restless thinker, not given to lingering over details, and 
was described by one of his contemporaries as "a conquerer, not a colonist." 
He also had the advantage of a prodigious memory, and habitually did his 
mathematics in his head as he paced back and forth in his study, writing it 
down only after it was complete in his mind. He was elected to the Academy 
of Sciences at the very early age of thirty-two. The academician who pro¬ 
posed him for membership said that "his work is above ordinary praise, 
and reminds us inevitably of what Jacobi wrote of Abel—that he had settled 
questions which, before him, were unimagined." 

Poincare's first great achievement in mathematics was in analysis. He gen¬ 
eralized the idea of the periodicity of a function by creating his theory of auto- 
morphic functions. The elementary trigonometric and exponential functions 
are singly periodic, and the elliptic functions are doubly periodic. Poincare's 
automorphic functions constitute a vast generalization of these, for they are 
invariant under a countably infinite group of linear fractional transforma¬ 
tions and include the rich theory of elliptic functions as a detail. He applied 
them to solve linear differential equations with algebraic coefficients, and 
also showed how they can be used to uniformize algebraic curves, that is, 
to express the coordinates of any point on such a curve by means of single¬ 
valued functions x(t) and y(t) of a single parameter t. In the 1880s and 1890s 
automorphic functions developed into an extensive branch of mathematics, 
involving (in addition to analysis) group theory, number theory, algebraic 
geometry, and non-Euclidean geometry. 

Another focal point of his thought can be found in his researches into celes¬ 
tial mechanics (Les Methodes Nouvelle de la Mecanique Celeste, three volumes, 
1892-1899). In the course of this work he developed his theory of asymptotic 
expansions (which kindled interest in divergent series), studied the stability 
of orbits, and initiated the qualitative theory of nonlinear differential equa¬ 
tions. His celebrated investigations into the evolution of celestial bodies led 
him to study the equilibrium shapes of a rotating mass of fluid held together 
by gravitational attraction, and he discovered the pear-shaped figures that 
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played an important role in the later work of Sir G. H. Darwin (Charles' 
son). 18 In Poincare's summary of these discoveries, he writes: "Let us imag¬ 
ine a rotating fluid body contracting by cooling, but slowly enough to remain 
homogeneous and for the rotation to be the same in all its parts. At first very 
approximately a sphere, the figure of this mass will become an ellipsoid of 
revolution which will flatten more and more, then, at a certain moment, it 
will be transformed into an ellipsoid with three unequal axes. Later, the fig¬ 
ure will cease to be an ellipsoid and will become pear-shaped until at last 
the mass, hollowing out more and more at its 'waist,' will separate into two 
distinct and unequal bodies." These ideas have gained additional interest 
in our own time; for with the aid of artificial satellites, geophysicists have 
recently found that the earth itself is slightly pear-shaped. 

Many of the problems he encountered in this period were the seeds of new 
ways of thinking, which have grown and flourished in twentieth-century 
mathematics. We have already mentioned divergent series and nonlinear dif¬ 
ferential equations. In addition, his attempts to master the qualitative nature 
of curves and surfaces in higher dimensional spaces resulted in his famous 
memoir Analysis situs (1895), which most experts agree marks the beginning 
of the modern era in algebraic topology. Also, in his study of periodic orbits 
he founded the subject of topological (or qualitative) dynamics. The type of 
mathematical problem that arises here is illustrated by a theorem he conjec¬ 
tured in 1912 but did not live to prove: if a one-to-one continuous transfor¬ 
mation carries the ring bounded by two concentric circles into itself in such 
a way as to preserve areas and to move the points of the inner circle clock¬ 
wise and those of the outer circle counterclockwise, then at least two points 
must remain fixed. This theorem has important applications to the classical 
problem of three bodies (and also to the motion of a billiard ball on a convex 
billiard table). A proof was found in 1913 by Birkhoff, a young American 
mathematician. 19 Another remarkable discovery in this field, now known as 
the Poincare recurrence theorem, relates to the long-range behavior of con¬ 
servative dynamical systems. This result seemed to demonstrate the futility 
of contemporary efforts to deduce the second law of thermodynamics from 
classical mechanics, and the ensuing controversy was the historical source 
of modern ergodic theory. 

One of the most striking of Poincare's many contributions to mathemati¬ 
cal physics was his famous paper of 1906 on the dynamics of the electron. 
He had been thinking about the foundations of physics for many years, and 
independently of Einstein had obtained many of the results of the special 
theory of relativity. 20 The main difference was that Einstein's treatment 
was based on elemental ideas relating to light signals, while Poincare's was 


18 See G. H. Darwin, The Tides, chap. XVIII, Houghton Mifflin, Boston, 1899. 

19 See G. D. Birkhoff, Dynamical Systems, chap. VI, American Mathematical Society Colloquium 
Publications, vol. IX, Providence, R.I., 1927. 

20 A discussion of the historical background is given by Charles Scribner, Jr., "Henri Poincare 
and the Principle of Relativity," Am. J. Phys., vol. 32, p. 672 (1964). 
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founded on the theory of electromagnetism and was therefore limited in its 
applicability to phenomena associated with this theory. Poincare had a high 
regard for Einstein's abilities, and in 1911 recommended him for his first aca¬ 
demic position. 21 

In 1902 he turned as a side interest to writing and lecturing for a wider 
public, in an effort to share with nonspecialists his enthusiasm for the mean¬ 
ing and human importance of mathematics and science. These lighter works 
have been collected in four books. La Science et VHypothese (1903), La Valeur 
de la Science (1904), Science et Methode (1908), and Dernieres Pensees (1913). 22 
They are clear, witty, profound, and altogether delightful, and show him to 
be a master of French prose at its best. In the most famous of these essays, 
the one on mathematical discovery, he looked into himself and analyzed his 
own mental processes, and in so doing provided the rest of us with some 
rare glimpses into the mind of a genius at work. As Jourdain wrote in his 
obituary, "One of the many reasons for which he will live is that he made it 
possible for us to understand him as well as to admire him." 

At the present time mathematical knowledge is said to be doubling every 
10 years or so, though some remain skeptical about the permanent value 
of this accumulation. It is generally believed to be impossible now for any 
human being to understand thoroughly more than one or two of the four 
main subdivisions of mathematics—analysis, algebra, geometry, and num¬ 
ber theory—to say nothing of mathematical physics as well. Poincare had 
creative command of the whole of mathematics as it existed in his day, and 
he was probably the last man who will ever be in this position. 


Appendix B. Proof of Lienard's Theorem 

Consider Lienard's equation 

£+/w£+*w-o, a) 

and assume that/(x) and g(x) satisfy the following conditions: (i) fix) and g(x) 
are continuous and have continuous derivatives; (ii) g(x) is an odd function 
such that g(x) > 0 for x > 0, and f(x) is an even function; and (iii) the odd 
function F(x) = f(x)dx has exactly one positive zero at x-a, is negative for 
0 < x < a, is positive and nondecreasing for x > a, and F(x) -> °° as x -*■ °°. 
We shall prove that equation (1) has a unique closed path surrounding the 


21 See M. Lincoln Schuster (ed.), A Treasury of the World's Great Letters, p. 453, Simon and 
Schuster, New York, 1940. 

22 All have been published in English translation by Dover Publications, New York. 
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origin in the phase plane, and that this path is approached spirally by every 
other path as t -*■ 

The system equivalent to (1) in the phase plane is 

dx 

■ f ( 2 ) 

j t =-g(x)-f(x)y. 

By condition (i), the basic theorem on the existence and uniqueness of solu¬ 
tions holds. It follows from condition (ii) that y(0) = 0 and g{x) # 0 for x # 0, so 
the origin is the only critical point. Also, we know that any closed path must 
surround the origin. The fact that 


d 2 x 

dt 2 


+ /(*) 


dx 

dt 


d_ 

dt 


dx 
— + 


dt 


j ’ f(x)dx 
o 




suggests introducing a new variable, 

z = y + F(x). 

With this notation, equation (1) is equivalent to the system 

' dx 


= z-F(x) 

= ~g(x) 


( 3 ) 


in the xz-plane. Again we see that the existence and uniqueness theorem 
holds, that the origin is the only critical point, and that any closed path must 
surround the origin. The one-to-one correspondence ( x,y ) <-» (x,z) between 
the points of the two planes is continuous both ways, so closed paths corre¬ 
spond to closed paths and the configurations of the paths in the two planes 
are qualitatively similar. The differential equation of the paths of (3) is 

rfz _ -g( X ) (M 

dx z - F(x) 


These paths are easier to analyze than their corresponding paths in the phase 
plane, for the following reasons. 
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First, since both g(x) and F(x) are odd, equations (3) and (4) are unchanged 
when x and z are replaced by -x and -z. This means that any curve sym¬ 
metric to a path with respect to the origin is also a path. Thus if we know the 
paths in the right half-plane (x > 0), those in the left half-plane (x < 0) can be 
obtained at once by reflection through the origin. 

Second, equation (4) shows that the paths become horizontal only as they 
cross the z-axis, and become vertical only as they cross the curve z = F(x). 
Also, an inspection of the signs of the right sides of equations (3) shows 
that all paths are directed to the right above the curve z = F(x) and to the 
left below this curve, and move downward or upward according as x > 0 or 
x < 0. These remarks mean that the curve z = F(x), the z-axis, and the verti¬ 
cal line through any point Q on the right half of the curve z = F(x) can be 
crossed only in the directions indicated by the arrows in Figure 97. Suppose 
that the solution of (3) defining the path C through Q is so chosen that the 
point Q corresponds to the value t = 0 of the parameter. Then as t increases 
into positive values, a point on C with coordinates x(t) and y(t) moves down 
and to the left until it crosses the z-axis at a point R ; and as t decreases into 
negative values, the point on C rises to the left until it crosses the z-axis at 
a point P. It will be convenient to let b be the abscissa of Q and to denote 
the path C by C b . 

It is easy to see from the symmetry property that when the path C b is con¬ 
tinued beyond P and R into the left half of the plane, the result will be a 
closed path if and only if the distances OP and OR are equal. To show that 



FIGURE 97 
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there is a unique closed path, it therefore suffices to show that there is a 
unique value of b with the property that OP = OR. 

To prove this, we introduce 


G(x) = j ’ g(x)dx 
o 


and consider the function 


E(x,z) = ^-z 2 + G(x), 


which reduces to z 2 /2 on the z-axis. Along any path we have 


dE , ,dx dz 

dt s dt dt 

r j.i dz dz 

-[Z-FMI- + Z- 

p/ \ dz 


SO 


dE = F dz. 


If we compute the line integral of F dz along the path C b from P to R, we 
obtain 


1(b) = jVdz = jdE = E R -E P = ^(OR 2 -OP 2 ), 

PR PR 

so it suffices to show that there is a unique b such that 1(b) = 0. 

If b < a, then F and dz are negative, so 1(b) > 0 and C b cannot be closed. 
Suppose now that b> a, as in Figure 97. We split 1(b) into two parts, 

Ii(b)= J Fdz + J Fdz and I 2 (b)=j*Fdz, 

PS TR ST 


so that 


m=m+i 2 (b)- 
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Since F and dz are negative as C h is traversed from P to S and from T to R, it is 
clear that Ifb) > 0. On the other hand, if we go from S to T along C h we have 
F > 0 and dz < 0, so J 2 (b) < 0. Our immediate purpose is to show that 1(b) is 
a decreasing function of b by separately considering Ifb) and I 2 (b). First, we 
note that equation (4) enables us to write 

Fdz = F^dx= -Z mx) dx. 
dx z-F(x) 

The effect of increasing b is to raise the arc PS and to lower the arc TR, which 
decreases the magnitude of [~g(x)F(x)]/[z - F(x)] for a given x between 0 and a. 
Since the limits of integration for Ifb ) are fixed, the result is a decrease in Ifb). 
Furthermore, since F(x) is positive and nondecreasing to the right of a, we see 
that an increase in b gives rise to an increase in the positive number -I 2 (b), 
and hence to a decrease in I 2 (b). Thus 1(b) = Ifb) + I 2 (b) is a decreasing function 
for b>a. We now show that I 2 (b) -> as b -> If L in Figure 97 is fixed and 
K is to the right of L, then 

I 2 (b)= hdz< f / dz < -(LM) ■ (LN) ; 

ST NK 

and since LN -> °° as b -> °°, we have I 2 (b) -> 

Accordingly, 1(b) is a decreasing continuous function of b for b > a, 1(a) > 0, 
and 1(b) -> as b It follows that 1(b) = 0 for one and only one b = b 0/ so 
there is one and only one closed path C bo . 

Finally, we observe that OR > OP for b < b 0 ; and from this and the symme¬ 
try we conclude that paths inside C bo spiral out to C bo . Similarly, the fact that 
OR < OP for b > b 0 implies that paths outside C bo spiral in to C bo . 



